What do I need to do if I moved away with my child whom I have full sole custody of?

I have sole physical and legal custody of my child thru the courts. Do I still need to file a leave of state if the non-custodial parent moved to another state years ago? I didn’t know any legal action was needed before we move, and have been living here over a year now. I told my ex-husband we were moving and he didn't have much to say about it. Could I get into trouble if he suddenly wanted to try and get custody? The visitation order simply states the respondent's right of visitation in the location as arranged by parties. The visitation shall be supervised by an individual approved by petitioner and at the location approved by her. He also has to give me 2 week notice before he comes to town, written agreement of day time and place the child will return to petitioner.