Under what conditions can a sole trustee be removed from his position?

I am sure the trustee of my special needs trust has been using my trust's funds for personal use. Under what conditions can he be removed as trustee? What rules and regulations is the trustee legally required to follow as the trustee? What are the requirements of proof I must furnish about any of his inproprieties? Can I just take my suspicions before any judge and expect the judge to ask him? The trustee lives in N.J. and I live in CA and he has not seen me since 1986 and has no first hand knowledge of my disability. He has gradually dispersed less and less monthly payments, until I stopped accepting, hoping the trust would "build up". He has since accused me of "making up" my disability in order to defraud my mother's estate. My mom's will says when I die the balance of my trust rolls over to him. Isn't that a conflict of interest for him as trustee? I am sixty years old and have been almost bedbound for the last eighteen years.