First - look in eyes of your co-workers - are they truthful? may be that is a joke and people just pulling your leg?... or trying to push you toward that person...
If indeed that is true - do not allow yourself to be drawn into negative discussions.
Talk to your supervisor or HR staff about the information you are getting regarding the person and request clarification - that doesn't mean your request will be addressed, but the fact of your request will be noticed.
Your supervisor may have ideas, or may be willing to address the issue.
If nothing works out - and you see the possibility to be involved into the conflict - you better start to look for another job...
The answer is an advisory opinion (not legal or financial advice). After accepting the answer bookmark it - you may return to this page later for reference or to ask for clarification. Appreciate your positive feedback.