Can I move to another state with my kids if the father doesn't care?

My husband and I are split and I have our two infant children. He has seen them once since we split up and that time he did he was drunk to the point he almost passed out. He smokes weed, takes pills, ect. And he does not pay child support nor does he have a job. I want to move me and my children to tishmingo oklahoma, with my boyfriend, and was wondering if there was any laws against it since he hasn't made any effort to be around or see them. I also wanted to know if there was any chance if he has a record of physical violence with me when I was pregnant and he has a old expunged rape case along with the drug abuse if he would be able to get joint custody? He has said that's what he wants but he has never even changed a diaper. I have very little money and just want to get divorce but terrified of him hurting my boys. He doesn't really care about them he just thinks if he has joint custody he wont pay child support. Just really confused.