To avoid potential issues later on (ex. motion for contempt filed by your husband on the basis that you are preventing him rightful access) you may want to move to modify (or terminate) the visitation. The likelihood of success will depend on a number of factors, including some of the things you mentioned, the circumstances surrounding your original divorce, the terms of your divorce decree (and any incorporated agreements).
Answered on Jan 03rd, 2013 at 11:59 AM