Whom do you try to avoid? An ex-employee? An estranged relative? An ex-associate? An especially demanding patient? An ex-boss? Someone you just can't stand being around?
You have allowed that person to imprison you.
It looks as if you're in control, orchestrating your life so you won't encounter them, expending massive amounts of energy in the process. Instead of being at ease, you're on guard. Instead of fully living, you find yourself continually defensive; on the lookout.
Eliminate this kryptonite from your life. It's based on the lie that this person "does" something to you. When in fact, whatever your reaction is, you do it to yourself. You create the uncomfortableness. You create the feelings of inferiority. You create the sense of dread. Or resentment.
If the person who is the source of all this angst lacks positive qualities (unlikely) then at least chose to become indifferent and lose the shackles.