Can the donor have rights over my daughter?

I have a 13-year relationship with a woman, we wanted to expand our family since we have both raised my 13-year-old biological daughter, my partner and I made a verbal agreement with a neighbor to donate his sperm to us, the conditions were that My daughter would not have the donor's last name, the donor would have no responsibilities for my daughter and would not have child support, he would have casual visits with my baby and would not have overnight visits. We trusted his word and we didn't know that we had to make any documents before that. He donated the sperm, my partner inseminated me at home and the baby came out. Now the donor, with the absence of legal documents regarding the agreement, sued me and demands rights. I have evidence of a message from this person where he admits that the agreement is that he would not have responsibilities. I need to know if the tumor is right despite admitting that he would not have responsibilities for my baby. I need help to defend my Family.