If you are known as someone who pretty much gets along with everyone, the fact that you don't like this one person - even if it isn't said outright and there's just an unspoken tension between the two of you - will stick out like a sore thumb and probably cause others to think twice about that person.
But if you're known as a moody bia who backstabs as often as she breathes and hates life and everyone in it, sorry, you're going to have to suck it up or get new friends.