How can I can deny visitation to an unfit father?

I moved out of my ex's house last February with my 12 month old son. The first weekend I reluctantly agreed for the father to have a visit. Within the first hour he had to call because my son wouldn't stop crying. Visits were supervised by me or my aunt from then on. He had pretty strange behavior soon after. The house was filled with liquor bottles, beer boxes, pizza boxes, rotten food in the fridge from when I left. He quit his job, got a new job and was fired within a week. He was kicked out of his apartment and lived with "friends." He lived in his car and then moved in with his grandmother. His visits were very random. He doesn't interact with our son hardly at all during the visits. And now sent me a custody order because I want to move from Pennsylvania to North Carolina. He was having visits sometimes twice a month or every other month. He asked for visits the day before sometimes but we already had plans. Can I get full custody with reasonable visits?