Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Part of the The Bayesian Investor — A Primer for the CIO series.

Use Case 5 — Performance & Risk Measurement and Attribution: The Scorekeeper

What it does. Every firm must answer two questions at the end of each period: where did our return come from? and where does our risk hide? This use case decomposes the portfolio’s return into its sources (which decisions added value, which just rode the market) and decomposes its risk into its contributors (which positions are the hazards), each with an honest confidence level.

The method. (A family of Bayesian attribution methods — see the catalog below for the specific method attached to each question, from Bayesian linear regression for return attribution through Bayesian risk decomposition for risk attribution.)

The analogy — the kitchen audit. After a great dinner service, the owner wants to know: was the success the menu (asset allocation), the cooking (security selection), or just the crowd (the market being in a good mood)? A naive look at the takings can’t separate these. The audit traces each dish back to its ingredients and each decision to its contribution — and, crucially, says how sure it is. “The menu added value” is one thing. “The menu added value, but we can’t actually be sure the crowd didn’t do it all” is a different, more honest, and more useful sentence.

The analogy — the fire-safety inspection. Risk is like fire hazard: you need to know where the risk lives, not just that “there is risk.” The inspection walks the building (the portfolio) and reports which rooms (positions) hold the most combustible material and how much of the total hazard each contributes. Some hazards are obvious (a big concentrated bet); some are sneaky (a cluster of positions that all catch fire together — a correlation risk that no single position reveals).

Why it matters for investing. This is the accountability engine of the firm. It tells you whether your process genuinely adds value or just rides the market’s tide, and it tells you where to concentrate risk-reduction effort. With confidence attached, it prevents both overconfidence (“we’re geniuses”) and false modesty (“we’re lucky”).

Why it beats the traditional approach. Traditional attribution gives point estimates — a single “alpha” number — with no sense of how much that number should be trusted. The Bayesian version separates skill from luck with an honest uncertainty band, decomposes risk into its true contributors (including hidden correlation risk), and knows when the honest answer is “too uncertain to say.”

Performance & Risk Attribution and Decomposition: A Focused Catalog

Here is a catalog of the scorekeeper’s tools — each answering one specific question, each with its analogy and its payoff. All of these are variations on the same Bayesian move: estimate, decompose, and attach an honest confidence level. The first group covers the core measurement questions; the second extends into timing, style, costs, and the deeper decomposition of both return and risk.

Use caseThe question it answersThe analogyHow it’s done with Bayesian modelingThe payoff
Return attributionWhich of my decisions actually added value this period?The kitchen audit — tracing each dish to its ingredientsEstimate a whole distribution for each decision’s contribution, not one number; the band shows whether the contribution is real or just noiseKnow which decisions earn their keep, with confidence
Risk attributionWhich positions are the true fire hazards?The fire-safety inspectionBuild the who-moves-with-whom map with its uncertainty, then compute each position’s share of total risk from that whole map — so the risk numbers carry their own confidenceConcentrate risk-reduction effort where it actually lives, including hidden correlation risk
Factor decompositionHow much of my return is the market’s weather, and how much is the captain’s steering?Separating the storm from the sailingLet the model itself decide which weather patterns (market, size, value, momentum) are real — shrinking the doubtful ones toward zero and keeping only the strongly-supported ones, each with a probabilityUnderstand exposure to market, size, value, momentum — not just “the market went up”
Allocation vs. selection splitWas the win the menu or the cooking?The chef’s menu vs. the ingredient shoppingFit both parts together with an uncertainty band around each, so the split is “menu contributed X, give-or-take Y” instead of a false-precision numberKnow whether asset-class choices or individual picks drove performance
Skill vs. luck (alpha vs. beta)Did we add value, or did the market just go up?The coin-flip judgeBuild a full distribution for skill, not a single number; if the band straddles zero, the honest answer is “can’t tell yet”Honest separation of skill from market exposure, with an uncertainty band
Regime-adjusted attributionWas our performance skill, or just the weather this quarter?The fair-weather checkTrack the hidden market mood (the regime) with its own probability, then compare actual results against what that mood would have produced anywayCompare results against what the regime would have produced anyway
Tracking-error / active contributionHow far are we drifting from the benchmark, and is the drift paying for itself?The odometer on how far from the indexSimulate many possible futures of the book against the benchmark, giving a range for how far the drift typically goes and whether it’s earning its keepUnderstand active risk taken vs. value added for taking it
Drawdown & tail attributionIf things go badly, which positions drive the worst paths?The worst-case autopsyRun thousands of possible future paths and look at the worst ones; report which positions appear in those painful paths most oftenKnow which exposures cause the painful scenarios, not just the average
Transaction-cost & turnover dragHow much are our own trades eating the returns?The leaky bucketEstimate the cost of each type of trade as a distribution from the actual trade history, so the drag number comes with its own confidenceQuantify the silent cost of activity, with confidence
Risk-budget contributionHow much of our total risk allowance does each position consume?The insurance premium per roomFrom the who-moves-with-whom map (with its uncertainty), compute how much of the total risk each position uses — including the sneaky clustered risk no single position revealsAllocate the firm’s risk appetite deliberately, not by accident
Market timingDid our “when” decisions add value, or would holding steady have been better?The chef who adjusts the menu before the crowd turns(Method: Bayesian timing regression.) Estimate how much of the return came from shifting the book over time rather than picking holdings, with a band that says whether the timing was real skill or just luckKnow whether active timing earns its keep or quietly detracts
Currency attributionHow much of our return is the currency move, and how much is the asset itself?The tip vs. the meal — part of the take is the exchange-rate “tip,” not the cooking(Method: Bayesian FX decomposition.) Split each period’s return into the currency component and the asset component, each with its own uncertainty bandKnow what the currency is doing to the book, so currency risk is managed deliberately
Style drift / style analysisIs the manager still investing the way we hired them to?The chef hired for French cuisine drifting toward fusion — useful to detect, not just returns(Method: Bayesian style regression.) Track the manager’s exposures to the style factors they were hired for, with a band that shows whether the drift is real or just noiseCatch style drift early, before it changes the character of the book
Income vs. price-return splitHow much is recurring income, and how much is capital appreciation?Salary vs. bonus — recurring pay vs. lumpy upside(Method: Bayesian yield decomposition.) Decompose the total return into the income stream and the price move, each with its own confidence, so the recurring part is never confused with the windfallUnderstand the quality and repeatability of the return
Fee & tax drag attributionWhat does the cost of running the book take from each decision?The leaky bucket, itemized pipe by pipe(Method: Bayesian net-of-cost decomposition.) Estimate the cost of each fee and tax layer as a distribution from the actual account records, so the drag is visible per sourceSee exactly where costs eat value, and which are worth paying
Interaction effectDid allocation and selection reinforce each other or cancel out?The dish is great because the menu and the cooking were aligned(Method: Bayesian interaction decomposition.) Isolate the part of the return that came from the combination of allocation and selection working together, with a band on whether that alignment was realKnow whether the process works as a whole, not just piece by piece
Manager skill consistency / persistenceIs last quarter’s skill repeatable, or a lucky streak?The chef who nails it once vs. the one who is consistently great(Method: Bayesian hierarchical skill model.) Pool the manager’s history across periods and strategies (the multi-office firm analogy), pulling short-run results toward the long-run pattern so a hot streak isn’t mistaken for abilityDistinguish durable skill from a lucky stretch, and size the manager accordingly
Marginal contribution to riskIf I add one more dollar to each position, how does total risk change?The fire inspector noting how adding a match here changes the hazard — the marginal, not average, effect(Method: Bayesian marginal risk contributions.) From the who-moves-with-whom map (with its uncertainty), compute how each extra dollar changes total risk — including how a position’s risk grows when everything else is already stressedSize positions by their next-dollar risk, not their average risk
Systematic vs. idiosyncratic splitHow much of our risk is the market’s weather, and how much is our own specific bets?The storm vs. the loose cargo — which part of the rocking is the sea, which is the boat(Method: Bayesian factor risk decomposition.) Split total risk into the part driven by shared market forces and the part unique to our holdings, each with its own confidenceKnow whether the book’s risk is mostly the market or mostly our own decisions
Stress-scenario contributionUnder a specific shock, which positions drive the loss?The domino autopsy per scenario — which domino does the damage in this crash(Method: Bayesian scenario analysis.) For each scenario, trace the direct links in the who-moves-with-whom map and report which positions carry the loss, with confidence on eachPrepare per-scenario answers, not just one average stress number
Leverage / derivative contributionHow much of our risk comes from borrowing and derivatives?The scaffolding vs. the building — borrowed structure amplifies the sway(Method: Bayesian overlay risk attribution.) Isolate the risk added by leverage and derivative overlays from the risk of the underlying holdings, with bands on eachKnow what the borrowed structure is doing, so leverage is a choice, not an accident
Illiquidity / stale-mark adjusted riskWhat is our real risk once private marks stop lying?Removing the smoothing filter that hides the true swing (the freshness-label problem from Use Case 3)(Method: Bayesian unsmoothing.) Treat the hidden true return as the target (the GPS from Phase 3), estimate the smoothing, and report risk on the unsmoothed viewStop private assets from looking like a free lunch of low risk
Intra-horizon risk decompositionWhich positions threaten the path, not just the year-end number?The autopilot alarm — who is steering toward the rocks mid-voyage(Method: Bayesian path risk attribution.) Simulate many future paths and report which positions most often push the book toward its danger line between measurement datesManage the journey’s risk, not just the destination
Risk-measure uncertaintyHow sure are we about our own risk number?The wobbly fire gauge — the instrument’s own measurement error(Method: posterior risk diagnostics.) Attach a confidence band to the risk estimate itself, so the report says “our risk is roughly X, give-or-take Y”Never report a risk number without its own uncertainty

The common thread. Every row is the same bookmaker’s move, pointed at the scorekeeper’s job: take a number that looks like a single fact, pull it apart into its honest components, and attach a confidence to every piece — estimate the whole distribution, decompose it, and never report a single number without its band. That is the discipline this roadmap builds — and it applies just as cleanly to deciding how to split your portfolio as to explaining what last quarter actually earned.

Where the Use Cases Plug Into the Roadmap

  • Use Cases 1 and 4 are portfolio-construction applications of Phases 1 and 2 (beliefs, models, and sampling) — building and allocating the book. Use Case 4 also draws on Phase 3 (the GPS/unsmoothing machinery for private assets) and Phase 4 (regime-awareness and the views channel) to run the full allocation operating system.
  • Use Case 3 is the Phase 4 sensor-fusion and regime-switching machinery, applied to the hardest reporting problem: private-asset stress.
  • Use Case 2 is a focused, high-conviction application of the Phase 2 modeling workflow to a one-off decision (IPO participation).
  • Use Case 5 and the catalog are the Phase 2 alpha/beta discipline scaled into the firm’s full performance- and risk-reporting engine.

Every use case is one idea — start with a belief, update it relentlessly, and never lose sight of how sure you are — wearing a different hat. Your team now has both the machinery and the map of where to point it.