Based on your information, it sounds like you may need to file a Petition to Legitimate with the court. You can also file a Petition to Change Custody and ask that you be awarded custody of the child. You certainly don't have to "just let it be" but it is important to file something soon. A family law attorney can help you with this.
Answered on Oct 16th, 2013 at 2:49 PM