I just signed an contingency agreement.

Yes you can get out of the contract. However, whether you will owe the attorney the contingency amount depends on where in the process the  termiantion comes about and whether your termination of the contract was for cause or without cause.  Also, the least amount that you will still owe the attorney is for the amount of time that he/she has spent working.