Can I change the legal description of my house away from "condominium"?

I recently attempted to refinance my home but they had to cancel the loan because the duplex that I own half of is considered a "condo", but has no HOA, HOA dues, or anything of that nature. We have separate utilities, yards, driveways - but a single shared "Party Wall" and a signed party wall agreement. My mortgage consultant said that I could petition the county to change my legal description to where it doesn't reference "condominiums", but as long as it does I can't get the refinance without an HOA which she said "may not make the most sense for you" . What are my legal options? What would it take to change the legal description away from "condominium"?