We have been a third floor illegal apartment for 3 months and was just told to leave so the landlords dont get in trouble with the town.

You may be entiitled to up to six month's relocation assistance at landlord's expense or the landlord may have to provide you another apartment that is legal if the landlord had an illegal apartment. You need to get in touch with an attorney right away.