I am not clear if your spouse overstayed a visa while in the US or not. If he was not in the US, it will not impact his immigrant visa petition. From what you have described if the two of you wish to live in the US you should move forward with the immigrant visa petition.
Answered on Aug 23rd, 2012 at 3:30 PM