How far away can a non-custodial parent before it causes visitation issues?

I have sole physical custody and my ex has visitation rights every other weekend. Since our divorce, my ex has consistently moved farther, still in the same state though. Our child is involved in activities that also take place on the weekends, which was agreed upon and she has been involved in for 6 years now. The problem I am having now is he moved 110 miles away, which is a 2 hour drive with no traffic. He does do all the driving, but now my child has to be in the car 2 hours on Friday back to his house, 2 hours back to her activity saturday, 2 hours back to his house after, and then 2 hours back to my house on Sunday. I do not think it is fair to my child to sit in the car for 8 hours. My child is getting older and is involved in more activities and school is going to become more intense as well. At what point can I fight for a visitation change due to his relocation? The only info I can find is that he can't move out of state, do I have other rights in Massachusetts?