If my daughter was taken at birth, can I sign my rights over to my mom before she is lost to me forever to her caregiver?

My newborn was placed with my aunt when born as I went to jail for a warrant. I spent a month in jail and when I went to court, they bypassed me on services because I failed prop 36. But it is both my wishes and her father's wish to voluntarily sign her over to my mom. She's currently with my aunt who wants to keep her but she and her husband are alcoholics and her husband was in rehab last March and didn't even complete 3 weeks but they gave him a certificate of completion. Can they adopt her? Can they deny my mom even though my mom lives out of state is a biracial couple (which my daughter is) and they have experience and knowledge of a drug exposed baby.