I am the permanent general co-guardian of my grandson. What rights do the parents have regarding his care? Can they take him?

The orders of guardianship should state what powers the guardian(s) have.  If you are not sure, see the materials posted here.  If still unsure, you should consult with a family law specialist well versed in guardianship and custody law.