Every year, thousands of high earners follow the same advice: make a non-deductible traditional IRA contribution and immediately convert it to a Roth. The backdoor Roth strategy is legal, well-documented, and genuinely useful. It also fails silently for a large share of the people using it, because of a single IRS rule they never knew existed.
That rule is called the pro-rata rule. Your brokerage will not flag it, and the IRS will not warn you. It simply makes your backdoor Roth conversion taxable, often almost entirely so, while you assume everything went through clean.
Who Gets Caught and Why It Feels Like a Trap
Consider a professional in their 40s who earns too much to contribute directly to a Roth IRA. In 2026, single filers can make a full direct Roth contribution only if their modified adjusted gross income (MAGI) falls below $153,000, with contributions phasing out entirely above $168,000. For married couples filing jointly, the phase-out begins at $242,000. A high earner above those thresholds discovers the backdoor strategy, opens a traditional IRA, contributes the 2026 annual limit of $7,500, and converts it to Roth. What they miss is the rollover IRA sitting at the same institution, left over from a 401(k) at a job they left three years ago.
Tax planning forums and CPA blogs are full of variations on this scenario. Someone rolled a former employer’s 401(k) into a traditional IRA years earlier, then started doing backdoor Roths without realizing the rollover IRA was sitting in the same pool. The pro-rata calculation was quietly taxing every conversion, and nobody noticed until a preparer ran the numbers on Form 8606.
- Income: Above Roth IRA direct contribution threshold (phase-out begins at $153,000 single / $242,000 married)
- Goal: Tax-free Roth IRA contribution via backdoor conversion
- After-tax contribution: $7,500 (2026 limit, under age 50)
- Hidden problem: Pre-existing rollover IRA with substantial pre-tax balances
- Result: Conversion is mostly taxable, defeating the strategy entirely
The Single Rule That Breaks the Math
Under IRC Section 408(d)(2), the IRS requires all traditional IRA assets to be treated as a single pool when calculating the taxable portion of any conversion. It does not matter that you opened a separate account, made a separate contribution, or intended to convert only the new after-tax dollars. The IRS sees all your traditional, rollover, SEP, and SIMPLE IRA balances as one combined number on December 31st of the conversion year.
A high earner with a $200,000 rollover IRA who makes a new $7,000 non-deductible contribution has a total IRA pool of $207,000. Only $7,000 of that is after-tax basis, roughly 3% of the total. When they convert the $7,000, the IRS taxes it based on the pre-tax share of the whole pool. Approximately 97% of the conversion is taxable, meaning nearly all of the $7,000 is treated as ordinary income. The goal of a tax-free conversion is entirely defeated.
At a 37% marginal rate, that $6,762 in taxable income costs about $2,500 in federal taxes alone, on a contribution the investor believed was going in clean.
The problem compounds with rollover IRA size. A physician with a $500,000 rollover IRA who has been doing backdoor Roths for five years without realizing the pro-rata rule applies has been paying ordinary income tax on roughly 98% of each $7,000 conversion. The cumulative tax error runs approximately $12,000 at a 37% rate. Worse, they have accumulated non-deductible contributions with no clean way to separate the basis from the pre-tax pool going forward.
One timing detail that surprises many people: the pro-rata calculation uses the IRA balance as of December 31st of the conversion year, not the date of the conversion itself. Contributing and converting in January does not help if a large pre-tax rollover IRA still exists at year-end. The only way to get a clean result is to have zero pre-tax IRA balances on the last day of the tax year.
It is also worth noting that the backdoor Roth remains entirely legal as of 2026. Proposals to eliminate the strategy have surfaced in Congress periodically, but none has been enacted into law.
Three Paths Forward, Ranked by Effectiveness
- Roll all pre-tax IRA assets into your current employer’s 401(k) before year-end. This is the cleanest fix. Moving all pre-tax IRA assets into a current employer 401(k) removes them from the pro-rata calculation entirely and restores the clean backdoor. Most large employer plans accept incoming rollovers, though you should confirm with your plan administrator before initiating a transfer. The critical timing detail: the rollover must be complete by December 31st of the year you intend to convert. When the rollover and conversion both happen in the same tax year, your IRA balance on December 31st reflects only the after-tax contribution, and the conversion is clean. This path works best for W-2 employees with a solid employer plan that accepts rollovers.
- Accept the tax cost and track your basis meticulously on Form 8606. If a 401(k) rollover is not available and the pre-tax IRA balance is modest, some people proceed and simply pay the tax on each conversion. The non-negotiable requirement is filing IRS Form 8606 every single year to track your cumulative after-tax basis. Skipping the form even once can mean paying taxes twice on the same money when you eventually withdraw. The IRS imposes a $50 penalty per missed filing, and the consequences of losing your basis record are far more expensive than the penalty itself.
- Address SEP and SIMPLE IRA balances separately if you have self-employment income. A SEP IRA or SIMPLE IRA from self-employment income counts toward the pro-rata calculation and must be addressed. If a solo 401(k) is available through self-employment, rolling the SEP balance into it removes those assets from the IRA pool. One important caveat applies to SIMPLE IRAs: they must remain open for at least two years before they can be rolled into a 401(k) without triggering a 25% early-withdrawal penalty, rather than the standard 10%. Contributions made in 2024 become eligible for rollover in 2026, so timing matters. This is an underappreciated fix for freelancers and consultants who assume their side-business retirement accounts are separate from the problem.
What to Do Before Your Next Conversion
Before making any IRA contribution this year, add up every dollar sitting in traditional, rollover, SEP, and SIMPLE IRAs. If that total is zero, the backdoor Roth works exactly as advertised. If it is anything above zero, there is a pro-rata problem to solve first.
The most common and costly mistake is converting first and asking questions later. A Roth conversion cannot be undone. Once the taxable event has occurred, the only remedy is to fix the underlying IRA structure before the next tax year. That does not undo the damage already done.
For anyone with a rollover IRA, the order of operations matters: contact your employer plan administrator, confirm they accept incoming rollovers, initiate the transfer, and only then make the non-deductible IRA contribution and convert. Reverse that sequence and you are back to paying ordinary income taxes on money you intended to shelter permanently.
Editor’s note: This article was updated to clarify the 2026 Roth IRA income phase-out range for single filers (which begins at $153,000 MAGI, not just the $168,000 hard cutoff), to specify the pro-rata rule’s precise statutory citation as IRC Section 408(d)(2), to note that the backdoor Roth strategy remains legal as of 2026 with no legislative changes enacted, and to add the two-year aging requirement for SIMPLE IRAs before they may be rolled into a 401(k) without a 25% penalty.
Contact [email protected] for any questions or corrections.