As florida is an at will employment state, If I quit without giving reason, can they hold that against me if I ever wish to return to them?

Yes.  An employer can refuse to hire you for any reason not barred by statute, such as race, religion, etc.  I know of no statute that prevents an employer from considering the fact that an applicant previously quit his/her job when deciding whether to hire them.