You may be challenged on your return, but I believe you are fully admissable to the US, as you never claimed political asylum personally, but got residence as his derivative, which did not require you to prove or claim political asylum.
Answered on Dec 15th, 2011 at 11:40 AM