A Familiar Crossroads at 65
He is 65, planning to retire at 67, and staring at $62,000 left on a 3.6% mortgage. He can throw an extra $1,300 a month at principal and knock it out before the last paycheck lands. On a retirement forum, a man in almost this exact spot asked whether he should just be done with the loan for peace of mind. It feels obvious: retire debt-free, sleep better.
The catch is where the payoff money comes from. If it comes out of a traditional IRA or 401(k), the withdrawal is ordinary income, and that extra income can drag a chunk of his Social Security check into the tax base. The mortgage is cheap. Paying it off with a big taxable withdrawal can cost far more than the interest it saves.
The Social Security Tax Torpedo, in Plain English
Social Security uses a formula called provisional income, roughly your adjusted gross income (AGI) plus tax-exempt interest plus half of your Social Security benefits. Cross $25,000 as a single filer (or $32,000 married filing jointly), and up to 50% of benefits become taxable. Cross $34,000 single or $44,000 joint, and up to 85% of benefits are pulled into taxable income. Those thresholds have not been indexed for inflation since 1984, so more retirees hit them every year. The Social Security Administration (SSA) explains the mechanics in its guidance on taxation of benefits.
Here is what that means in practice. Say he needs a $60,000 lump sum from his traditional IRA to wipe out the loan. That amount lands on top of his other income. It can thrust more of his Social Security into the 85% taxable zone, add federal tax on the withdrawal itself, and, because Medicare uses a two-year lookback, bump him into a higher IRMAA premium tier in 2028. One decision, three tax consequences.
Meanwhile, the mortgage is doing very little damage. At 3.6%, he is borrowing well below the 4.48% yield on a 10-year Treasury and the 3.75% fed funds upper bound. Late in a mortgage, most of each payment is principal, so extra payments save relatively little in remaining interest. And with the 2026 standard deduction at $16,100 for a single filer and $32,200 for a couple, most retirees do not itemize, so the mortgage interest is not producing a deduction anyway.
How This Fits the Rest of the Puzzle
His Social Security check itself will grow with inflation. The 2026 cost-of-living adjustment (COLA) came in at 2.8%, which silently raises the base that provisional income is measured against. Any strategy that keeps more of that check out of the 85% zone compounds over the rest of his life.
Two workarounds preserve the peace-of-mind goal without feeding the torpedo:
- Pay from taxable savings or a brokerage account. Selling assets with modest gains does not create ordinary income the way an IRA withdrawal does, so provisional income barely moves.
- Spread the payoff across tax years. Retiring at 67 with a partial payoff in 2028 and the rest in 2029 can keep each year below the next torpedo or IRMAA tier.
A mortgage in retirement can be perfectly manageable when the rate is this low and the loan is this small.
What to Think Through Before Signing the Check
The hardest mistake to undo is a big tax-deferred withdrawal made in a single calendar year. The tax is paid, the Social Security is taxed, the IRMAA surcharge is locked in two years out, and the money is no longer compounding.
Before touching a traditional account, it is worth modeling the tax cost of the withdrawal alongside the interest saved. If the payoff can come from cash or taxable savings, the torpedo concern largely disappears, and the peace-of-mind case is legitimate, especially for a surviving spouse who would inherit a single income and a paid-off house. Small differences in where the dollars come from can change the answer entirely, so it is worth running the numbers with a tax preparer who has seen this exact tradeoff before making it permanent.
Contact [email protected] for any questions or corrections.
Top Gaining Stocks
Top Losing Stocks