The Backdoor Roth IRA: How the Pro-Rata Rule Kills the Tax Benefit

The scenario

You earn too much to contribute directly to a Roth IRA (MAGI above $168,000 single or $252,000 married, where the phase-out fully closes in 2026). The standard advice is to do a "backdoor Roth": make a nondeductible contribution to a traditional IRA, then immediately convert it to a Roth. Since the contribution was after-tax, the conversion should be tax-free.

Except you have $195,000 in pre-tax traditional IRA money from old 401(k) rollovers. You contribute $7,500 of after-tax money and convert it. The conversion is mostly taxable: the IRS says 96.5% of it is pre-tax, so the "tax-free conversion" you expected turns into a real tax bill at your ordinary marginal rate.

Why the pro-rata rule exists

The IRS treats all of your traditional IRA accounts as a single pool for conversion purposes. You cannot cherry-pick which dollars to convert. When you convert any amount, the conversion is a proportional slice of your total IRA balance — part pre-tax, part after-tax (basis).

The formula: taxable percentage = (total pre-tax IRA balance) / (total IRA balance including the new contribution)

In our example (2026):

• Pre-tax IRA balance: $195,000
• New nondeductible contribution: $7,500 (this is after-tax basis)
• Total IRA balance: $202,000 (rounded; $195,000 + $7,500 = $202,500)
• Taxable percentage: $195,000 / $202,000 = 96.5%

When you convert $7,500 to a Roth:

• Taxable portion: $7,500 × 96.5% = $7,238
• Non-taxable portion (basis): $7,500 × 3.5% = $262

At a 24% marginal rate, you owe about $1,737 in federal tax on the conversion. At 32%, it's about $2,316. And the $7,500 in your Roth came at a significant tax cost — far from the "tax-free conversion" you expected.

One thing the pro-rata rule does not do: it doesn't make your basis disappear. The portion of your $7,500 contribution that wasn't converted tax-free (the 96.5% deemed pre-tax) leaves behind unused basis. That leftover basis carries forward on Form 8606 to future years — it isn't lost. It will reduce the taxable portion of later conversions or withdrawals.

What counts as "total IRA balance"

The pro-rata calculation includes:

• All traditional IRAs (including rollover IRAs, SEP IRAs, and SIMPLE IRAs after the 2-year holding period)
• Measured on December 31 of the year you convert — not the date of conversion
• Across all accounts at all institutions — even if they're at different brokerages

What does NOT count:

• Roth IRAs (already post-tax)
• 401(k), 403(b), or 457(b) plans (employer plans are separate)
• Inherited IRAs (separate from your own)

The December 31 timing matters: if you contribute and convert in January, but then roll over a $200,000 401(k) into a traditional IRA in November, that rollover balance is included in the year-end calculation. The conversion you did in January is now mostly taxable.

The reverse rollover fix

The most common solution is to move pre-tax IRA money back into an employer plan, leaving only the nondeductible basis in the traditional IRA.

Before the fix (2026):

• Traditional IRA: $195,000 pre-tax + $7,500 basis = $202,500
• Pro-rata: 96.5% taxable

After rolling $195,000 into your current 401(k):

• Traditional IRA: $7,500 (all basis, $0 pre-tax)
• Pro-rata: 0% taxable

Now the $7,500 backdoor Roth conversion is completely tax-free, as intended.

Requirements for the reverse rollover:

• Your current employer's 401(k) must accept incoming rollovers (most large plans do)
• Only pre-tax money can go into the 401(k) — the after-tax basis stays in the IRA
• This must be completed before December 31 of the conversion year

If you don't have a current 401(k) (retired, self-employed without a solo 401(k)), this option may not be available. Self-employed individuals can open a solo 401(k) specifically for this purpose — but check the plan documents first: not all solo 401(k) plans accept incoming rollovers, and many low-cost prototype or discount-broker plans specifically do not. You may need a plan with a custom or non-prototype adoption agreement to route pre-tax IRA money in.

Worked example: with and without the fix

Sarah, age 45, earning $280,000 (2026)

Over 20 years at 7% growth, that $7,500 in a Roth becomes roughly $29,000 — all tax-free. Without the fix, Sarah effectively paid $9,816 to get $7,500 into the Roth. With the fix, it cost $7,500 — money she already earned and paid taxes on.

If Sarah does this every year for 20 years, the cumulative tax cost without the fix is roughly $46,000 in unnecessary taxes.

What if you can't do the reverse rollover?

If your employer plan doesn't accept rollovers and you're not self-employed, your options are limited:

Option 1: accept the tax hit

If your pre-tax IRA balance is small (say, $20,000), the pro-rata effect is manageable. With $20,000 pre-tax and a $7,500 contribution, the taxable percentage is about 73% — not ideal but not catastrophic.

The break-even question: is the tax-free growth of the Roth over your remaining lifetime worth the upfront tax cost? For a 35-year-old in the 24% bracket, the answer is usually yes — decades of tax-free compounding outweigh the conversion tax. And any basis that doesn't convert tax-free carries forward on Form 8606, so it's not wasted.

Option 2: convert the entire IRA

Instead of just the $7,500 backdoor, convert the entire $202,500 to a Roth. Yes, you'll owe a large tax bill (roughly $48,000-$65,000 depending on your bracket), but the pro-rata problem disappears permanently, and all future growth is tax-free.

This makes sense if:

• You have cash outside retirement accounts to pay the tax (never pay conversion taxes from the IRA itself)
• You're in a temporarily low tax bracket (between jobs, sabbatical, early retirement)
• You expect to be in a higher bracket in retirement (large pension, high RMDs)

Option 3: skip the backdoor entirely

If you have a large pre-tax IRA and can't do the reverse rollover, the backdoor Roth may not be worth the tax cost. Instead, consider:

• Maxing your Roth 401(k) if your employer offers one
• After-tax 401(k) contributions with in-plan Roth conversion (the "mega backdoor")
• Taxable brokerage investments with tax-efficient index funds

Multi-year conversion strategy

For large pre-tax IRA balances, a phased approach can work:

Year 1: reverse-roll as much as possible into 401(k). Convert the remaining basis to Roth.

Years 2-5: if some pre-tax money couldn't be rolled over (e.g., SIMPLE IRA within the 2-year window), convert portions each year, staying within your current tax bracket.

Ongoing: once the pre-tax balance is zero, do the standard backdoor Roth annually — contribute $7,500 nondeductible (2026), convert immediately, zero tax.

Common mistakes

Forgetting the December 31 rule: converting in January and then rolling over a 401(k) into a traditional IRA in June. The year-end balance includes the rollover, retroactively making your January conversion taxable.

Not filing Form 8606: nondeductible traditional IRA contributions must be reported on Form 8606 every year. This is also where your leftover basis carries forward — if you don't track it, the IRS may treat your entire conversion as taxable. Keep every Form 8606 you've ever filed.

Converting gains: if your $7,500 nondeductible contribution grows to $7,700 before you convert, the $200 in gains is taxable even with no pro-rata issue. Convert quickly — same day or next business day — to minimize gains.

The bottom line

The backdoor Roth is powerful, but a large existing pre-tax IRA balance turns it into a mostly taxable event. The fix is almost always a reverse rollover: move pre-tax IRA money into your employer's 401(k) (or a solo 401(k) that accepts incoming rollovers), leaving only basis in the traditional IRA. Do this before December 31 of the conversion year, and your backdoor Roth works as advertised. And remember — any basis that doesn't convert tax-free isn't lost; it carries forward on Form 8606.