Do I have to do an inspection together with my landlord to avoid him charging me with abandonment?

My landlord failed to send a renewed lease because he wanted me to pay cash, so he could avoid paying taxes on the property (he explained this to me in detail). When I expressed concern, asked for receipts, etc., he told me I had to leave. He is now telling me that it is considered abandonment if I don't do a walk-through with him and sign the inspection form together. I don't want to be alone with him, I don't want him knowing my next address, etc. There is no damage to the apartment, it's spotless, and I don't owe him any money (I am not asking for my security deposit back so I don't have to tell him where I am living now).