Is that possible for a foreigner to start a new bank in U.S.? I am having a student Visa in U.S.

Anybody can organize a bank in the United States. However, you cannot accept deposits lawfully unless you have been approved by the Federal Deposit Insurance Corporation. That is not going to happen with a foreign student as the organizer.