Do I have any recourse on my loan if my loan contract lists a bank that I never made payments too?

Back in 2011 I purchased a used vehicle from a local dealer. At that time I had applied for financing and was approved. I began making payments to Capital One Auto Finance. Over the course of the loan. I feel I was charged inappropriate fees and was subjected to a couple late payment marks on my credit report. I do not believe that I made payments late and have attempted to dispute on several occasions. However, I am met with difficulty with verification. During a dispute i asked that Capital One send me a copy of my loan contract. While reviewing this I noticed that my contract was actually assigned to Ford Motor Credit and not Capital One Auto Finance. To confirm this I dug through old documents and found my original signed contract and sure enough Ford Motor Credit. My assumption is that because Capital One doesn’t have a contract listing them as the creditor then they can’t report those late payments and further nor were they authorized to charge any fees or interest on loan.