If you were never discharged as Administrator, the case was never closed and any heir or creditor can raise an issue with the Court concerning your failure to handle your duties properly. If you believe you performed all of your duties and you have distributed all property of the estate, you should file a petition for discharge seeking to be relieved of any further obligations related to the estate.
If your brother is trying to have you removed, or to force you to provide information, then yes, he can seek court action in your father's estate. The appointment of an administrator does not mean that the court can't do anything else.
If you are the administrator and your brother is trying to have a court remove you or force you to do something, then you need to get an attorney if you don't already have one. Estate-related litigation is not a good do-it-yourself project, and you can face personal liability if your actions (or lack of action) is determined to have caused damage to the estate or the parties interested in it. Find an attorney who is experienced in both estate administration and probate work and also estate and trust related litigation. Best wishes to you.
Consumers can use this platform to pose legal questions to real lawyers and receive free insights.
Participating legal professionals get the opportunity to speak directly with people who may need their services, as well as enhance their standing in the Lawyers.com community.