The issue for the financial institution is the interest, and it earns curiosity on loans it makes to other people.
There is an alternative choice to a standard checking account or pay as you go card. Many corporations are easily accessible offering loans at a low curiosity.