How does a non custodial parent get rights revoked?

My ex boyfriend and I have a child together. He does not contact me in any way about her and hasn't set any plans up involving her in over a year in a half. He would have his now ex girlfriend set everything up. If he pays child support, not by choice, he fought me hard about paying it. If he continues to pay but continues to not contact her will his rights be revoked? My husband would love to adopt her, but bio dad said no.