Purchased new home with understanding that hoa was specifically meant for maintenance of retention basin and common grounds.all 16 homes are now occu

Hoa in place at time of purchase was specifically for maintenance of retention basin and common grounds . All 16 homes are now occupied and a group of residents are insisting on putting a new hoa in place with specific rules despite being informed that hoa was not to have any effect on homes/property of residents. How can we stop this from forming and claiming they will now have jurisdiction over our home? We have contacted them and provided statement from builders rep that the intention of hoa was strictly as I have stated and was not to expand into resident's property. They have refused to stop forming new hoa. How can we protect ourselves from this invasion of our property rights?