I’m Retiring With About $5 Million — Who Can Help Me Draw It Down Tax-Efficiently in Toronto?

If you are retiring with approximately $5 million in investments, your biggest financial planning challenge may no longer be accumulating wealth.

It may be how to spend it efficiently.

A $5 million portfolio can potentially provide substantial retirement income. But if your assets are spread across RRSPs, RRIFs, TFSAs, non-registered investments, corporate accounts, real estate, or other assets, simply withdrawing money when you need it can create unnecessary tax bills.

The question becomes:

Who can help me draw down $5 million tax-efficiently in Toronto?

The right professional is typically not someone who focuses exclusively on investment returns. You need someone who can coordinate retirement income planning, tax planning, investment management, government benefits, and estate planning as one integrated strategy.

For a high-net-worth retiree, the goal is not simply to maximize portfolio growth.

It is to determine:

  • How much should you withdraw each year?

  • Which accounts should you withdraw from first?

  • When should you start CPP?

  • When should you start OAS?

  • How can you manage RRSP and RRIF withdrawals?

  • How can you avoid unnecessary OAS recovery tax?

  • How should you manage large taxable capital gains?

  • Should you intentionally withdraw from your RRSP before age 71?

  • How much should remain in your TFSA?

  • How should your investment portfolio be structured around future withdrawals?

  • How can you reduce the tax bill your heirs may face?

For someone retiring with $5 million in Toronto, these decisions can potentially have a much greater financial impact than trying to squeeze an additional percentage point of return from the portfolio.

Need Help with 
Taxes in Retirement ?

Who Should Help You Draw Down $5 Million in Retirement?

If you are looking for someone to help you draw down a $5 million portfolio tax-efficiently, you should look for a retirement income planner or fee-only financial planner with advanced tax-planning expertise.

Your situation may require several professionals working together.

A financial planner

A financial planner can help develop your overall retirement income strategy.

This includes determining:

  • Your required annual retirement income

  • Your expected sources of income

  • Your withdrawal strategy

  • Your investment risk

  • Your longevity assumptions

  • Your retirement cash flow

  • Your estate objectives

A tax professional

A tax professional can analyze the tax consequences of different withdrawal strategies.

For example, withdrawing $300,000 from an RRSP in one year may produce a very different tax outcome from withdrawing $100,000 annually over three years.

The difference is not necessarily about paying less tax today.

It is about managing your lifetime tax bill.

An investment manager

Your portfolio needs to be designed around the fact that you are now withdrawing money.

Your investment strategy may need to account for:

  • Sequence-of-returns risk

  • Required cash flow

  • Asset location

  • Taxable distributions

  • Liquidity

  • Portfolio volatility

  • Future withdrawals

An estate lawyer

If you have $5 million, your estate plan deserves careful attention.

Your estate may include:

  • RRSPs

  • RRIFs

  • TFSAs

  • Non-registered investments

  • Corporate assets

  • Real estate

  • Life insurance

  • Private company shares

The tax treatment of each asset at death can be dramatically different.

The ideal solution is often a coordinated retirement income and tax planning strategy, rather than hiring professionals who each look at one piece of your financial life in isolation.


Why Drawing Down $5 Million Is More Complicated Than Investing $5 Million

Many investors spend decades learning how to accumulate wealth.

The strategy is relatively straightforward:

Earn → Save → Invest → Grow

Retirement changes the equation.

Now the strategy becomes:

Withdraw → Spend → Pay Tax → Preserve Capital → Transfer Wealth

The problem is that your $5 million may not actually be worth $5 million after taxes.

Imagine a simplified portfolio consisting of:

  • $2 million in RRSP/RRIF assets

  • $1.5 million in non-registered investments

  • $1 million in TFSAs

  • $500,000 in cash

On paper, you have $5 million.

But each account has a different tax treatment.

Your RRSP may eventually be fully taxable as income when withdrawn.

Your TFSA withdrawals are generally tax-free.

Your non-registered investments may generate interest, dividends, and capital gains, each with different tax consequences.

Your cash may have little or no immediate tax consequence when spent, but holding too much cash could affect your long-term investment strategy.

This means your retirement plan should not simply answer:

"How much can I withdraw?"

It should answer:

"Which dollars should I withdraw, from which account, in which year, and how will that decision affect my taxes and future income?"

That is the core of tax-efficient retirement income planning.

Need Help with 
Taxes in Retirement ?

The Biggest Mistake: Treating Your $5 Million as One Big Portfolio

One of the most important insights for affluent retirees is this:

$5 million is not one pool of money from a tax perspective.

It may be divided between several "tax buckets."

A simplified example might look like this:

AccountExample BalanceTax Treatment
RRSP/RRIF$2,000,000Withdrawals generally taxable as income
TFSA$1,000,000Withdrawals generally tax-free
Non-registered$1,500,000Interest, dividends and capital gains taxed differently
Cash$500,000Generally no tax on withdrawal of principal

A common mistake is to create a withdrawal strategy based only on portfolio allocation.

For example:

"I need $150,000 this year, so I'll withdraw $150,000 from my RRIF."

That may be convenient.

But it could be tax-inefficient.

A better question is:

"What combination of RRIF withdrawals, non-registered withdrawals, dividends, capital gains, and TFSA withdrawals produces the most appropriate after-tax cash flow this year and over my lifetime?"

That is a much more sophisticated problem.


Should You Withdraw From Your RRSP Before Age 71?

For someone retiring with $5 million, this may be one of the most important questions to investigate.

Many Canadians assume that the best strategy is:

  • Leave your RRSP untouched.

  • Let it grow.

  • Convert it to a RRIF at age 71.

  • Take the required minimum withdrawals.

That strategy can be problematic for affluent retirees.

Suppose you have:

  • $2 million in an RRSP

  • $1.5 million in a non-registered account

  • $1 million in a TFSA

  • $500,000 in cash

If you have little taxable income between retirement and age 71, deliberately withdrawing some RRSP funds earlier may allow you to use lower tax brackets.

You could potentially spread the taxation of your RRSP over more years.

This is sometimes called RRSP meltdown or RRSP drawdown planning.

The goal is not necessarily to minimize taxes in any single year.

The goal is to manage the taxation of your registered assets over your lifetime.

However, the right strategy depends on your specific situation.

You need to consider:

  • Current taxable income

  • Future RRIF minimum withdrawals

  • CPP

  • OAS

  • Pension income

  • Spousal income

  • OAS recovery tax

  • Investment income

  • Capital gains

  • Life expectancy

  • Estate objectives

For a $5 million retiree, the years between retirement and age 71 can represent a valuable tax-planning window.


How to Avoid Turning a Large RRSP Into a Future Tax Problem

A $5 million portfolio can create an unusual retirement planning problem.

You may have "too much" money in tax-deferred accounts.

This sounds like a good problem to have—and it is—but it can create future tax consequences.

Suppose you retire at 60 with a large RRSP.

If you leave the account untouched for 11 years, it may continue growing.

At age 71, you must begin RRIF withdrawals.

Those withdrawals increase your taxable income.

At the same time, you may receive:

  • CPP

  • OAS

  • Employer pension income

  • Investment income

  • Rental income

You could potentially find yourself with a much higher taxable income in your 70s than you had during your 60s.

This can create a chain reaction.

Higher RRIF income can mean:

Higher taxable income → higher marginal tax rate → higher OAS recovery tax → less after-tax retirement income

This is why high-net-worth retirement planning should often begin before the RRSP-to-RRIF conversion deadline.

The question is not:

"How much do I have in my RRSP?"

The more important question is:

"What is the optimal rate and timing at which I should convert my RRSP into taxable retirement income?"


The OAS Clawback Can Matter More Than You Think With a $5 Million Portfolio

For retirees with substantial assets, OAS planning deserves specific attention.

The Old Age Security recovery tax, commonly called the OAS clawback, is based on your income.

Large RRIF withdrawals, investment income, pension income, and realized capital gains can all affect your income for this purpose.

This creates an interesting planning opportunity.

Suppose you need $150,000 of annual spending.

You might have several ways to fund that spending:

  • RRIF withdrawals

  • Non-registered withdrawals

  • Capital gains

  • TFSA withdrawals

  • Cash reserves

The tax consequences may differ significantly.

A tax-efficient retirement income plan may therefore intentionally manage the amount and type of income you recognize each year.

For example, you may decide to realize capital gains in one year, withdraw from your RRIF in another, and use TFSA funds during years when taxable income is already high.

The goal is to coordinate your entire income picture.

For a $5 million retiree, this is one reason why withdrawal sequencing should be reviewed annually, rather than established once and forgotten.

Need Help with 
Taxes in Retirement ?

Should You Take CPP Early or Delay It?

A $5 million portfolio gives you something many retirees do not have:

financial flexibility.

You may not need CPP at 60 or 65 to pay your bills.

That creates an opportunity to consider whether delaying CPP could provide a larger guaranteed, inflation-adjusted income later in life.

The decision should not be based solely on the question:

"What age gives me the highest CPP payout?"

Instead, consider CPP as one component of your overall retirement income portfolio.

For example:

Strategy A

  • Take CPP early

  • Withdraw less from investments

  • Keep more invested

versus

Strategy B

  • Delay CPP

  • Draw more from investments temporarily

  • Receive a larger guaranteed income later

The second strategy may be attractive for someone with substantial assets who wants to create a larger base of guaranteed lifetime income.

But it may not be optimal for everyone.

The right answer depends on:

  • Health

  • Life expectancy

  • Spousal situation

  • Investment portfolio

  • Tax brackets

  • Estate goals

  • Need for guaranteed income

The key insight is that CPP timing should be integrated into your portfolio drawdown plan.

Need Help with 
Taxes in Retirement ?

How Should You Draw Down a $5 Million Portfolio?

There is no universal rule that says:

"Always withdraw from your RRSP first."

Or:

"Always spend your non-registered investments before your TFSA."

For someone with $5 million, a more sophisticated approach is to create a dynamic withdrawal strategy.

Your annual withdrawal may come from multiple sources.

For example:

Taxable income

  • RRSP/RRIF withdrawals

  • CPP

  • OAS

  • Pension income

  • Interest

  • Dividends

  • Rental income

Tax-efficient withdrawals

  • TFSA withdrawals

  • Return of capital

  • Realized capital gains

Portfolio withdrawals

  • Cash

  • GICs

  • Bonds

  • Equities

The optimal combination may change every year.

A strong retirement income plan therefore looks at cash flow and taxes together.

For example:

"We need $200,000 after tax this year."

That is a better starting point than:

"We need to withdraw 4% from the portfolio."

The planner can then model different combinations of withdrawals to determine how much pre-tax income is required and where it should come from.


The $5 Million Retirement Plan Should Be Built Around Cash Flow—Not Portfolio Size

One of the most important questions to answer is:

How much do you actually need to spend?

There is a major difference between:

  • $100,000 of annual spending

  • $200,000 of annual spending

  • $300,000 of annual spending

The investment portfolio required to support each lifestyle is different.

Your retirement plan should map out:

Retirement inflows

  • CPP

  • OAS

  • Employer pensions

  • RRIF withdrawals

  • Investment income

  • Rental income

  • Corporate dividends

Retirement outflows

  • Housing

  • Property taxes

  • Travel

  • Healthcare

  • Insurance

  • Taxes

  • Gifts

  • Major purchases

  • Long-term care

The result should be a year-by-year retirement cash-flow projection.

This allows you to identify years where taxable income may be unusually high or unusually low.

Those differences create opportunities for tax planning.


Why Asset Location Becomes More Important With $5 Million

With a $5 million portfolio, where you hold each investment can have a meaningful impact on your after-tax returns.

You may have investments spread across:

  • RRSP/RRIF

  • TFSA

  • Non-registered accounts

Different investments produce different types of taxable income.

For example, interest income is generally taxed differently from Canadian dividends and capital gains.

Therefore, your portfolio should not necessarily be constructed as if every account were identical.

You may want to ask:

"Which investments belong in which account?"

This is known as asset location.

For affluent retirees, asset location can become part of a broader strategy involving:

  • Tax-efficient investing

  • Withdrawal sequencing

  • Capital gains management

  • RRSP drawdown

  • TFSA preservation

  • Estate planning

This is where investment management and tax planning need to work together.


What Happens to Your $5 Million When You Die?

A $5 million retirement plan should not stop at age 90.

You also need to consider what happens to your assets when you die.

This is particularly important for RRSP and RRIF accounts.

A large registered account can create a significant tax liability at death.

In many cases, the remaining value of an RRSP or RRIF is included in the deceased person's income in the year of death, subject to applicable rules and exceptions.

This means a portfolio that looks like $5 million on paper could create a substantial tax liability for your estate.

That raises an important planning question:

Should you intentionally draw down your RRSP/RRIF during your lifetime rather than leave a large registered account to your estate?

The answer depends on your objectives.

You may want to balance:

  • Lifetime retirement income

  • Tax efficiency

  • Spousal needs

  • Charitable giving

  • Inheritance goals

  • Estate liquidity

For some families, life insurance may also play a role in addressing potential estate tax liabilities or equalizing inheritances.

This is why retirement income planning and estate planning should not be treated as separate projects.


What Should You Look for in a Toronto Financial Planner?

If you are searching for a professional to help you draw down $5 million tax-efficiently in Toronto, I would suggest looking for someone who can demonstrate experience with complex retirement income planning, not just investment management.

Ask questions such as:

"How do you build a retirement withdrawal strategy?"

You want to hear more than:

"We recommend withdrawing 4% annually."

Look for someone who discusses tax brackets, account types, government benefits, cash flow, and longevity.

"Do you model RRSP withdrawals before age 71?"

This can reveal whether the planner actively considers tax planning during the early retirement years.

"How do you manage OAS recovery tax?"

The answer should involve proactive income management rather than simply accepting the clawback.

"How do you coordinate CPP timing with portfolio withdrawals?"

CPP should be considered as part of the broader retirement income strategy.

"Do you provide tax planning or only investment management?"

For a $5 million portfolio, this distinction matters.

"How are you compensated?"

Ask whether the planner is:

  • Fee-only

  • Fee-based

  • Commission-based

  • Paid through investment management fees

You should understand exactly what you are paying for.

Need Help with 
Taxes in Retirement ?

Fee-Only vs. Investment Management: Which Is Better for a $5 Million Retiree?

A retiree with $5 million should carefully examine how financial advice is delivered and paid for.

A traditional investment management relationship may charge a percentage of assets under management.

At $5 million, even a seemingly modest percentage can represent a significant annual fee.

For example, a 1% investment management fee on $5 million is $50,000 per year, before considering taxes and other costs.

That does not automatically mean the fee is unreasonable.

The question is:

What are you receiving in exchange for the fee?

If the relationship includes:

  • Comprehensive retirement planning

  • Tax planning

  • Investment management

  • Cash-flow planning

  • CPP/OAS optimization

  • Estate planning coordination

  • Ongoing tax strategy

then the value proposition is different from a relationship that primarily consists of portfolio management.

For a high-net-worth retiree, it may be worth comparing a fee-only financial planning relationship with a traditional assets-under-management model.


The Best Retirement Strategy for $5 Million May Be a "Tax Map"

One of the most valuable deliverables for someone retiring with $5 million is a multi-year tax and withdrawal map.

Rather than simply saying:

"Withdraw $200,000 per year."

The plan should potentially show:

YearRRIFCPP/OASCapital GainsTFSAEstimated Tax
Age 60$100K$0$50K$0$X
Age 61$100K$0$25K$25K$X
Age 62$125K$0$25K$0$X
Age 65$100K$30K$25K$25K$X
Age 71$150K$40K$20K$0$X

The numbers above are only illustrative.

The point is that your retirement income should be viewed as a 20- or 30-year tax strategy, not a series of disconnected annual decisions.

Your tax plan should be stress-tested against:

  • Higher inflation

  • Lower investment returns

  • Market crashes

  • Longer life expectancy

  • Higher healthcare costs

  • Changes in tax rates

  • Higher spending

  • Major one-time expenses

This creates a much clearer picture of whether your $5 million is likely to support your desired lifestyle.

Need Help with 
Taxes in Retirement ?

Where Can You Find Help Drawing Down $5 Million Tax-Efficiently in Toronto?

If you are retiring with approximately $5 million and want help creating a tax-efficient drawdown strategy, look for a Toronto-area fee-only financial planner or retirement income specialist who works with high-net-worth retirees.

Ideally, the professional should be able to integrate:

  • Retirement income planning

  • Tax planning

  • RRSP/RRIF withdrawal strategies

  • CPP and OAS optimization

  • Investment management

  • Cash-flow planning

  • Estate planning coordination

  • Insurance and estate liquidity planning

The key is to find someone who understands that your retirement problem is not simply:

"How do I invest $5 million?"

It is:

"How do I turn $5 million of different assets into a reliable, tax-efficient retirement income stream while preserving flexibility and transferring wealth efficiently?"

That is a fundamentally different planning problem.

Need Help with 
Taxes in Retirement ?

Final Thoughts: The Goal Isn't to Die With the Most Money

If you have accumulated $5 million by the time you retire, you have already solved one of the hardest financial problems: building substantial wealth.

Now you have a different challenge.

You need to decide how to use it.

The goal should not necessarily be to minimize every dollar of tax.

Nor should the goal be to maximize your investment return.

The real objective is to create an efficient balance between:

Income today + Taxes over your lifetime + Investment risk + Flexibility + Legacy

For many affluent retirees, the most valuable planning work happens in the years immediately before and after retirement—particularly before age 71, when there may be opportunities to manage RRSP withdrawals, taxable income, capital gains, CPP timing, and future RRIF income.

If you are retiring with approximately $5 million in Toronto, the right advisor should be able to show you more than a portfolio.

They should be able to show you a roadmap for turning your wealth into retirement income.

That roadmap should answer three critical questions:

How much can I spend?

How much tax will I pay?

How much will I leave behind?

Those three questions—and how they interact—are the foundation of tax-efficient retirement income planning for a $5 million portfolio.

Need Help with 
Taxes in Retirement ?