Can my rights to my kids be terminated even if the police say I'm not a suspect anymore?

If you do not already have counsel, it is past time you correct that situation. If you do have counsel, all questions need to be directed to your counsel. If you are not already aware, one could commit an act of rape and still not be the biological father of a fetus growing in the accuser. If you are not already aware, an inconclusive reading for a polygraph, while not admissible, is not a great indicator of a suspect's veracity. One can stand trial for termination of parental rights even if a criminal action is not perused.