Does a parent with specific visitation have the right to remove the child from their school at times other than their scheduled visitation?

the most recent visitation stipulation was made 03/2014 and at no point in time is a visit scheduled during school hours. The first custody/ visitation stipulation from 2012 states that neither parent will remove the child from school without first notifying the other parent. (this original stipulation had granted the father all day Monday visitation) The parent with visitation has interpreted this as him having the right to remove our child as he pleases from school. He feels that I am breaking the visitation stipulation because I insist he can only take the child during his scheduled court ordered visits. Am I correct in saying he may only take the child during the agreed court ordered visit times?