Can my husband use his ex wife's divorce attorney to divorce me?

A conflict of interest can arise when a lawyer represented you before.  Since the lawyer only represented someone who in essence was a stranger to you, there is no conflict.  Even if the lawyer wanted to represent a new husband of the ex-wife in another divorce, that might be allowed.  The restriction is only to the extent that the prior representation gives the lawyer an unfair advantage in the new representation.