Does the father of my daughter have the right to not allow our 17 year old daughter come stay with me in NJ with my girlfriend?

He has informed me that if I don't provide him with details of who our daughter will be around, the living accommodations and where she will be sleeping, he will not allow her to come stay with me in NJ where I will be moving by the end of the month. I was in a relationship with him for 22 years. We lived in a house in Deer Park on Long Island that he purchased in 2008. I lived there and contributed financially until he told me I had 3 weeks to move out in May of this year. I moved 15 minutes away with my brother in Central Islip and my daughter was going to move with me until he convinced her to stay because we would be sharing a room and bed. I saw my daughter almost everyday because she works with me during the summer. Now because I am in a relationship with a woman, I think this is why he is now creating road blocks. I want to know if he can do this and what are my rights as her mother.