3. Costs Are Certain

🧩 Before you read: a problem to solve

You are choosing between two funds for your retirement account. Fund A charges 0.04% per year and tracks the S&P 500 index. Fund B charges 0.75% per year and is actively managed by a team whose flagship strategy has beaten the S&P 500 in 8 of the last 10 calendar years, after fees. The manager has appeared on financial television and manages over $20 billion. Your colleague invests in Fund B and tells you that choosing Fund A is “leaving money on the table.”

You will be investing for 30 years. Which fund do you choose — and what else do you need to know before deciding?

“The average actively managed dollar earns the market return before costs. If active management costs more, it earns less after costs. This is not a study. It is arithmetic.”

Of all the claims in the investment canon, the one that survives with the least qualification is also the most boring: costs matter. This chapter explains why cost discipline is the first constraint, what it does and does not prove, and how it functions as a hurdle for every other decision in the portfolio.

The chapter is not long because the argument is complicated. It is long because the argument is simple — and simplicity that powerful deserves to be understood thoroughly, since ignoring it is the most expensive mistake an investor can make.

The arithmetic

William Sharpe’s 1991 paper, “The Arithmetic of Active Management” (Financial Analysts Journal 47(1), pp. 7–9), establishes a result so narrow and so devastating that its full implications still have not been absorbed by the investment industry three decades later:

1. Define a market (e.g., all U.S. stocks, all global stocks, all bonds in a given category).
2. Passive investors, by definition, hold the market in proportion to its market capitalization and earn the market return before costs.
3. The remaining investors — the active aggregate — must also earn the market return before costs, because collectively they hold the same securities. Every share that is overweighted by one active investor is underweighted by another; the sum of all active positions relative to the market is, by construction, zero.
4. If active management incurs higher fees, trading costs, spreads, taxes, and administration, the active aggregate earns less after costs — by exactly the amount of those higher costs.

This is not an empirical claim about whether managers are skilled, whether markets are efficient, or whether some strategy “works.” It is an accounting identity. Within a correctly defined market, the asset-weighted active aggregate equals the market before costs and lags when its costs are higher. No study can overturn it.

Why this is so powerful — and so frequently evaded. The Sharpe argument does not require markets to be efficient. Even in a wildly inefficient market where prices deviate from fundamental value by large margins, the active aggregate still earns the market return before costs — because active investors collectively are the market. Skill can redistribute returns among active investors (the best take from the worst), but it cannot create aggregate outperformance. The arithmetic is inescapable: costs deducted from the aggregate must reduce the aggregate.

This is why the distinction between the Efficient Market Hypothesis (EMH) and the Cost Matters Hypothesis (CMH) — a term Bogle used — matters. EMH says prices are right. CMH says costs are certain. You can reject EMH — you can believe markets are frequently mispriced, that bubbles form and burst, that behavioural biases create exploitable patterns — and the cost arithmetic still holds. Mispricing creates opportunities for some active investors to beat others, but not for the active aggregate to beat itself.

What this does not prove:

• That every active manager loses. Some do beat the market after costs — the question is whether persistent, identifiable skill exists or whether outperformance is indistinguishable from luck at practical sample sizes. The arithmetic is about the aggregate, not the individual. A few managers will always beat the market by chance alone; the relevant question is whether the winners persist beyond what random chance predicts.
• That every index is suitable. A poorly constructed index (concentrated, front-run by arbitrageurs, inappropriately benchmarked, or poorly tracked by its fund) can be worse than a well-run active fund. Sharpe specifically warned that an inappropriate benchmark or an equal-weighted manager average can create misleading comparisons.
• That a single cap-weight index is a complete portfolio. It is a building block, not a finished product. The market being “correct” for the cost comparison does not mean it is the correct portfolio for a specific investor’s liabilities, currency, or spending horizon.

What it does prove: The default implementation for any exposure should be the lowest-cost version that accurately captures that exposure. An investor who pays more for the same market exposure starts behind and must overcome the cost hurdle before adding any value. In a world where broad global equity index funds are available at 0.03–0.20% expense ratios, the hurdle for deviating is higher than at any point in history — and the cost of being wrong about a manager’s skill compounds over decades.

The evidence beyond the arithmetic

Sharpe’s identity tells us the active aggregate must lose. Evidence tells us it does.

SPIVA persistence scorecards. S&P Dow Jones Indices publishes semi-annual reports tracking the performance of actively managed funds against their relevant benchmarks. The consistent finding across markets, time periods, and fund categories: the majority of active funds underperform their benchmarks over 5-, 10-, and 15-year horizons. More importantly, funds that outperform in one period show no reliable tendency to outperform in the next. Past outperformance does not predict future outperformance — which is exactly what we would expect if outperformance were largely attributable to chance in a high-noise environment.

Ken French’s aggregate cost estimate. Kenneth French (2008, “The Cost of Active Investing,” Journal of Finance) estimates that U.S. investors collectively spent approximately 0.67% of the total market capitalization of U.S. equities annually on fees, expenses, and trading costs — roughly $100 billion per year at the time of the study. This is not money that disappeared into a black hole; it is a transfer from investors to the financial services industry. Every dollar of cost saved is a dollar that stays in the investor’s pocket, compounding at the market rate.

Survivorship bias. The SPIVA data understate the problem. Funds that close or merge — typically the worst performers — disappear from the database. The reported active-fund performance is the performance of survivors, and it still trails the benchmarks. The true investor experience, accounting for funds that died, is worse.

The Bogle addendum. Bogle’s empirical contribution to the cost argument was to show that the pre-cost performance gap between active and passive funds was approximately zero — exactly what the arithmetic predicts. Active managers, in aggregate and before costs, matched the market. After costs, they trailed. There was no pre-cost alpha to offset the fees; the fees simply reduced returns.

The compounding of friction

Costs that look small in isolation compound powerfully. The math is inexorable:

Consider an investor with a 30-year horizon and a 5% nominal expected return. A $100,000 initial investment:

These are order-of-magnitude illustrations, not precise predictions. The exact numbers depend on the return assumption and the sequence of returns. But the mechanical point does not: a cost that looks small in any single year — “it’s only 1%” — becomes material over decades. Over a 30-year horizon, a 1% annual cost difference consumes roughly a quarter of terminal wealth. Over a 50-year horizon (a young investor saving for retirement and then spending through it), it consumes roughly 40%.

And these are just the explicit fees. Trading costs, bid–ask spreads, market impact, tax inefficiency from turnover, and cash drag (the return penalty from holding uninvested cash to meet redemptions) are additive. The total cost of active management — what the investor actually loses — is typically larger than the headline expense ratio.

The hidden costs

The headline expense ratio is not the whole story. Implementation diligence extends to at least five categories of hidden friction:

Tracking difference. An ETF with a 0.05% expense ratio that systematically trails its index by 0.30% per year (due to sampling error, withholding tax treatment, corporate-action handling, fair-value pricing adjustments) is more expensive than it looks. The relevant number is the total gap between the fund return and the index return, not the advertised fee. Some funds consistently track within a few basis points of their index; others show persistent negative drift. The difference, compounded, is real money.

Securities lending. Index funds lend securities to short sellers and split the revenue with the fund company. Revenue retention policies vary dramatically: some funds return 100% of lending revenue to shareholders; others keep 30% or more. A fund with a 0.03% expense ratio that keeps 30% of lending revenue may be more expensive in total than a fund with a 0.07% fee that returns all revenue. The expense ratio alone does not capture this.

Index methodology changes and front-running. When an index rebalances on a known schedule (the S&P 500 announces changes days in advance; the Russell indices reconstitute on a published calendar), arbitrageurs can trade ahead of the rebalance, buying stocks they know will be added and selling those that will be deleted. The index tracker buys at slightly elevated prices, imposing a small but recurring cost. The magnitude varies by index construction; some indices include anti-front-running measures such as buffer zones and staggered rebalancing. Others do not.

Tax efficiency. Turnover generates taxable events. A fund with identical pre-tax returns can deliver materially different after-tax returns depending on its portfolio turnover rate and its realization policy for capital gains. In a taxable account, a fund that realizes 5% of its portfolio in gains annually creates a tax drag that compounds alongside the expense ratio. In a tax-sheltered account, this is irrelevant — which is one reason the adaptation layer (Chapter 13) treats account type as a key input.

Market impact. A fund that trades large blocks in less liquid securities moves prices against itself. The cost is invisible in the expense ratio but real in the return. This is primarily an issue for active funds with high turnover and for index funds tracking less liquid market segments (small-cap stocks, emerging markets, high-yield bonds).

The practical implication. Due diligence on an implementation includes reading the fund’s tracking difference history, its securities lending policy, its index methodology, its tax efficiency track record, and its liquidity profile. None of this appears in a single number. Cost discipline is a practice, not a glance at the expense ratio.

Does this mean active management is always wrong?

No. The arithmetic says active is a negative-sum game in aggregate. It does not say that every active deviation is an error. Three types of active decisions can be rational:

1. Tax management. Direct indexing or systematic tax-loss harvesting that realizes losses while deferring gains provides a structural benefit independent of security selection skill. The mechanism is tax-code asymmetry, not market mispricing. It survives cost scrutiny because the benefit has an identifiable source other than “the manager is smart.”

2. Factor exposure. Deliberately tilting toward value, momentum, quality, size, or other factors is active relative to a cap-weight benchmark — but can be implemented systematically at relatively low cost (10–30 basis points above a plain index). This is evaluated under the factor-tilt framework (Chapter 9), not under the cost rule alone. The relevant question is whether the expected factor premium, net of implementation costs and after accounting for the risk of extended underperformance, justifies the tilt.

3. Liability customization. Matching a specific future spending stream may require bonds or instruments not held in a generic bond index. An investor who needs €50,000 in nominal terms in exactly seven years may be better served by a bond maturing in seven years than by a constant-duration bond fund — even if the individual bond involves a modest commission. The cost is justified by a specific liability match, not by a claim of manager skill.

The hurdle, not the prohibition. The cost rule treats active deviation as a hurdle, not a prohibition. Any deviation must name its mechanism, estimate its incremental costs (explicit and hidden), and state what benefit justifies those costs. “I think this manager is smart” does not clear the hurdle. “This factor tilt has a documented risk premium, can be implemented at 15 basis points, and I accept that it may underperform for a decade” might.

Why costly active management persists

If the arithmetic is this clear, why do investors continue to pay high fees for active management that underperforms in aggregate? Three forces sustain the industry:

1. The marketing of outperformance. Past winners attract disproportionate flows. A fund that beats its benchmark for three years — whether by skill or chance — can gather billions in new assets, generating fee revenue that far exceeds the losses from underperformance in later years. The incentive structure rewards gathering assets, not generating alpha.

2. The narrative premium. Active managers sell stories. “We invest in quality companies at reasonable prices.” “We identify disruptive innovation before the market.” “We protect capital in down markets.” These stories are psychologically compelling in a way that “we track an index at minimal cost” is not. The cost arithmetic is boring; the narrative is not. Investors pay for the story.

3. The overconfidence of the buyer. Most investors believe they can identify the skilled managers in advance — or believe they themselves are the skilled manager. The evidence (SPIVA persistence, French cost estimates, the arithmetic itself) says otherwise, but evidence is a weak competitor to the conviction that this time I will be different.

These forces are not going away. The cost rule exists precisely because the market does not enforce it automatically. You have to choose low costs; the default is high costs.

The practical implication

The rule: cost discipline. Use low-cost broad exposure as the default implementation. Any active manager, concentrated holding, factor tilt, complex vehicle, or frequent trading rule must clear an explicit hurdle: name the mechanism, estimate the all-in costs, and state the benefit that justifies them.

This is not an allocation rule — it does not tell you what to hold. It tells you that however you construct your exposure, the cheaper version of the same exposure starts ahead. In a world where broad global equity index funds are available at 0.03–0.20% expense ratios, the hurdle for deviating is higher than at any point in history.

What the cost rule does not answer

Cost discipline tells you to seek cheap implementation. It does not tell you:

• Whether you should hold stocks, bonds, gold, or crypto in the first place;
• Whether a global or domestic index is appropriate for your liabilities;
• Whether a factor tilt is worth its incremental cost;
• What percentage to allocate to anything.

Those are questions for the other constraints and the adaptation layer. Cost is the first gate — not the only one.

Key idea: Costs are the one variable you control with certainty. Returns are uncertain. In a compounding game, certain costs deserve more attention than uncertain returns. The Sharpe arithmetic is an identity, not a study — it cannot be overturned by new data, better models, or smarter managers. Make low-cost implementation the default; require an explicit justification for anything else.

Cost discipline tells you to implement cheaply. It does not tell you what to implement. The second constraint — diversification — answers the next question: given that I should own something cheap, what should that something be?