Can parole tell you you can not live in a specific COUNTY or TOWN? Isn’t that discrimination or a violation of my rights?

I was recently paroled and parole had tried to bar me from living in my home town AND county. Despite no charges or court ordered restraining order they are also trying to tell me my legal wife and I can have no contact . Again there are NO charges or restraining orders, just parole saying so. She has NO criminal record and they’ve told me I can’t live in my town or county. I feel I’m being harassed! Is there anything I can do? I’ve already requested a meeting w a supervisor which has been denied.