Why do some banks have much higher NIMs than others?

Banks have different net interest margins (NIMs) because they fund themselves at different costs and earn different rates on their loans. A bank with lots of free checking accounts and a portfolio of higher-rate business loans will naturally earn a wider spread than one relying on expensive funding to make low-rate mortgages. Geographic competition, bank size, and business model choices push NIMs even further apart.

NIM variation across banks is normal, persistent, and often quite wide. Two banks of similar size in neighboring states might report NIMs of 2.80% and 4.20%, and both could be performing well relative to their business models. Understanding what drives that gap matters for anyone comparing bank profitability, because a raw NIM number without context can be misleading.

The Deposit Side: Where the Biggest Advantages Live

The single largest driver of NIM differences is deposit franchise quality. Banks fund their lending operations primarily with deposits, and the cost of those deposits varies enormously. A bank where 35% of total deposits sit in non-interest-bearing accounts (business operating accounts, personal checking that pays no interest) has a massive cost advantage over a bank where that figure is 12%.

Non-interest-bearing deposits are free funding. When a bank lends money sourced from free deposits, the entire loan yield flows to NIM with no funding cost to subtract. Building a large base of these deposits takes years of branch presence, relationship banking, treasury management services for commercial clients, and community reputation. A strong deposit franchise is one of the most durable competitive advantages in banking.

Even within interest-bearing deposits, costs vary widely. A bank relying on stable, low-cost savings and money market accounts has a structural advantage over one that depends on rate-sensitive CDs or brokered deposits. The total cost of deposits for well-funded community banks might run 1.00-1.50%, while a bank leaning on wholesale or rate-sensitive funding could be paying 2.50% or more for the same dollar of deposits.

Loan Mix and the Yield-Risk Tradeoff

On the asset side, what a bank lends on determines its yield. Different loan categories carry fundamentally different interest rates:

Small business and SBA loans often price at 7-9%, producing wide spreads

Commercial real estate loans typically price at 6-8%, depending on property type and borrower strength

Residential mortgages, particularly conforming fixed-rate loans, price much lower and are often sold rather than held

Large corporate credit facilities, where borrowers have multiple alternatives, might price at just 1-2% over the bank's cost of funds

A bank specializing in small business lending and commercial real estate will carry a meaningfully higher average loan yield than one focused on prime residential mortgages or investment-grade corporate credit. The spread between these business models can easily account for 100-200 basis points of NIM difference.

The catch is risk. Higher-yielding loans almost always carry higher credit risk. A community bank with a 4.50% NIM built on small business and CRE lending will eventually absorb higher credit losses than a bank with a 3.20% NIM from high-quality corporate and residential loans. After charge-offs, the net result may be closer than the raw NIM numbers suggest. Comparing NIM without also examining credit quality metrics like non-performing loan ratios and net charge-offs gives an incomplete picture.

Geography, Competition, and Market Dynamics

Where a bank operates affects NIM from both sides of the balance sheet. Banks in less competitive markets can price loans at wider spreads because borrowers have fewer alternatives. They can also pay less on deposits because depositors have fewer places to go.

Community banks in rural or less competitive suburban markets often carry NIMs 50-100 basis points wider than similarly sized banks in major metropolitan areas. This geographic premium is real, but it can be fragile. It depends on limited competition persisting, and a new entrant or aggressive digital bank offering higher deposit rates can compress it quickly.

Metropolitan banks face persistent pricing pressure. On the lending side, borrowers in large cities can shop multiple banks, credit unions, and non-bank lenders. On the deposit side, competition for consumer and commercial deposits pushes rates higher. The result is thinner spreads on both sides of the business.

Why Smaller Banks Typically Have Wider NIMs

Bank size creates structural NIM differences separate from operational quality. Community banks (generally under $10 billion in assets) routinely report NIMs 50-150 basis points wider than the largest banks. Several factors contribute:

Smaller banks make smaller loans, which carry wider spreads because per-loan origination and servicing costs are spread across less principal

Community banks tend to hold more of their loans on balance sheet rather than selling them, keeping the yield

Large banks hold proportionally more low-yielding liquid assets (Fed reserves, government securities) to meet regulatory liquidity requirements, pulling down average asset yields

Large banks participate in competitive syndicated and capital markets lending where margins are razor-thin

This doesn't mean community banks are more profitable overall. Larger banks offset thinner NIMs with scale advantages in non-interest income (investment banking fees, trading revenue, asset management) and greater operating efficiency. NIM is one component of profitability, not the whole picture.

High NIM vs. High-Quality NIM

Not all wide NIMs are created equal. The source of a bank's NIM tells you more than the level itself. A 4.00% NIM can come from very different places:

A strong deposit franchise (low funding costs) paired with moderate-yield, high-quality loans. This is the best combination because it's sustainable and doesn't require excessive credit risk.

A mediocre deposit franchise paired with very high-yield, high-risk lending (subprime auto, unsecured consumer, high-LTV CRE). The NIM looks impressive until a credit cycle hits and losses consume the extra spread.

Geographic monopoly where limited competition allows pricing power on both sides. Durable as long as the competitive environment holds, but vulnerable to disruption.

The most valuable NIMs are those supported by low-cost, stable funding and moderate-risk lending. These NIMs hold up across interest rate cycles and credit cycles because neither the funding base nor the loan portfolio is fragile.

When you see a bank with a significantly higher NIM than its peers, the first question should be: where is the extra margin coming from? If it's from a genuinely superior deposit franchise, that's a sign of competitive strength. If it's from aggressive lending in higher-risk categories, the elevated NIM may be borrowing from future credit losses.

Making NIM Comparisons Meaningful

The most productive way to compare NIM is within a peer group of banks that share similar characteristics:

Similar asset size (within the same bracket, such as $1-5 billion)

Similar geographic markets or market types (urban vs. suburban vs. rural)

Similar business model focus (commercial bank vs. mortgage-heavy vs. specialty lender)

Within a well-constructed peer group, NIM differences are more likely to reflect genuine franchise strength and operational execution rather than structural factors that make direct comparison misleading.

A bank that consistently ranks in the top quartile of NIM within its peer group, while maintaining average or better credit quality, is demonstrating real competitive advantage. That combination of wide margins and clean credit is the mark of a strong deposit franchise and disciplined lending.

Related Metrics

Related Valuation Methods

Peer Comparison Analysis