am I in trouble because I moved away with my son for economic reasons over 8 years ago?

8 yrs ago I was loosing my apartment because I lost my job I asked my son's father to move in with me because I didnt want to move away, and I planned on getting my job back after two months, thats the time walmart gives before you can get your job back. I told him if I loose my apt I cant stay there in Texas, because I have no one to live with , or help me. I tried so hard to get a room mate. I asked my son's father for help to keep the apt he said NO he was living with his parents rent free. So I had no choice but to move in with my mom in oklahoma, a 12 hour drive away from the father. So for the past 8 yrs the father and I have been handling visitation by meeting half way and during all that time he hasn't started any legal trouble over it. It's only recently that he's starting to bring this up by threatening me with jail time, and saying I have no choice but to move back to texas. what are my options? thank you.