I have a question about a someone in management at my place if employment.

I started working at this company about a year and a half ago and almost immediately this man in management started coming on to me. Every day he would talk to me for hours. Soon he started asking me out and to come over to his house. Well I wasn't interested and politely refused. It got back to my other coworkers and I was told that since I turned him down and would not sleep with him he will get me in trouble and try his best to get me fired. As he has done this with other before with other women who wouldn't sleep with him. Well as to date he has successfully gotten me into trouble twice so far. And came close to being fired. And both times it has been for things that weren't a big problem but were blown up and made to seem bigger than they were by him. My question is can I do anything anything to stop this scumbag from doing this to me and other women?