Passport Question

My ex-husband will not sign for my son to get a passport because he believes I will take him to Bangladesh and never return, even though I am a US citizen, my husband is a US citizen, we have our whole lives here and never once even mentioned going to Bangladesh, in fact spoke out against going there. We wanted this passport to visit my family in England. According to my state of Michigan I can take him anywhere where the country is part of the Hague convention. What can I do when the ex-husband's reasoning is all contrived in his head and based on nothing but a need to control? I plan on taking this to the court.