Carlo Hofer

← Stock-level index tracking · Investment research

Investment research

Stock-level index tracking: the results

A benchmark rebuilt month by month from CRSP's list of S&P 500 members, and a long-only mandate held close to it under four covariance estimators from July 1999 to December 2024: its tracking error, what its turnover is made of, and its active return by sector and by factor. Every figure of the mandate is a simulation drawn from the tables committed with the code.

Simulated on CRSP and Compustat data to 31 December 2024, extraction of 28 September 2026Last build: 18 November 2026

What was tested, the main results and where every number comes from.

Realised tracking error
78.9 to 83.6
bp a year, the four estimators under the mandate, July 1999 to December 2024, simulated, before fees
Forecast bias
1.48 to 1.85
realised over forecast on the four estimators, 1 for a calibrated forecast
Forced turnover
11.4%
of one-way turnover is forced by index changes, 2.99 of 26.26 per cent a year, Ledoit-Wolf estimator under the mandate, simulated
Benchmark rebuilt
11.5
bp a year of tracking error against CRSP's value-weighted return of the same list, January 1926 to December 2024, with dividends
  • Under the mandate the four covariance estimators realise 78.9 to 83.6 basis points a year of tracking error, and each one's forecast understates it. The bias statistic, realised over forecast, is 1.48 to 1.85, above the band of 0.8 to 1.25 fixed before the run.
  • Index changes force 2.99 per cent a year of the Ledoit-Wolf path's 26.26 per cent of one-way turnover, or 11.4 per cent. On the Ledoit-Wolf estimator, loosening the cap on chosen turnover from 0.5 per cent a month to none raises it from 6.3 to 59.4 per cent a year, while the realised tracking error stays between 76.3 and 79.4 basis points a year. On the factor estimator chosen turnover rises from 6.2 to 14.9 per cent a year and the tracking error falls from 83.3 to 79.6.
  • Month by month, allocation is the largest of the three Brinson-Fachler terms on the Ledoit-Wolf, factor and principal-component estimators: 16.4 to 16.7 basis points a month in absolute value on average, against 10.6 to 13.8 for selection and 1.5 to 2.2 for interaction. Over the 306 months the active return is 0.2 to 13.7 basis points a year before costs, within one Newey-West standard error of zero on every path, as is each of its three terms, and the six factors explain 2 to 13 per cent of its variance.
  • The benchmark rebuilt from CRSP's list of index members reproduces CRSP's own value-weighted return of the same list with a tracking error of 11.5 basis points a year from 1926 to 2024. Its momentum and variance spreads have correlations of 0.888 and 0.954 with Kenneth R. French's large-cap spreads.1

Figure 1 | Forecast and realised tracking error under the mandate, four covariance estimators, July 1999 to December 2024

Each estimator's mean forecast (hollow) beside the tracking error it realised (filled), in basis points a year, with the bias statistic.

Every realised value lies to the right of its forecast. The four estimators realise 78.9 to 83.6 basis points a year, and the bias statistic, 1.48 to 1.85, lies above the band of 0.8 to 1.25 on all four. The forecast is the tracking error the month's own covariance matrix implies for the weights the optimiser chose.

Simulated. Monthly rebalancing. Before fees. Bias statistic: the standard deviation of each month's active return divided by that month's forecast, over the months with a forecast, 1 for a calibrated forecast.

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

Table 1 | The four gates and nine expectations, fixed before each run, and what the run found

A gate not met stops the study. An expectation not met is reported as a finding, in the same words as one met. An expectation named for two or more estimators has one verdict, met only if it holds for each.

Fixed before the runWhat the run foundVerdict
G1Tracking error of the benchmark against CRSP's own return of the same list, at most 50 bp a year11.5 bp a yearMet
G2Usable window at least 15 years99 yearsMet
G3At least 90 per cent of removals with a CRSP price within 10 trading days100 per cent of 836Met
G4Capitalisation in at least 90 per cent of membership months for at least 90 per cent of names99.5 per cent of 1,912 namesMet
E1That tracking error at most 20 bp a year and the mean difference within 2 bp, with dividends and price-only11.5 and 11.6 bp a year, −0.18 and −0.16 bpMet
E2Count within 10 names of CRSP's in every month, value within 2 per cent in at least 95 per cent of months1,188 and 1,186 of 1,188 monthsMet
E3Momentum and variance spreads: correlation at least 0.80 with French's, mean difference within two standard errors0.888 and 0.954, 1.15 and 0.29 standard errorsMet
E4, first clauseSample condition number at least 10 times the Ledoit-Wolf one in every month86 of 306 monthsNot met
E4, second clauseUnder the mandate, the sample estimator's realised tracking error above the Ledoit-Wolf one80.6 against 78.9 bp a yearMet
E5On the frontier, the mean forecast does not rise as the cap loosens, and the realised tracking error is lower at 4 per cent than at 0.5holds for the factor estimator, fails for Ledoit-Wolf (79.0 against 76.3 bp a year)Not met
E6Realised tracking error 50 to 150 bp a year and bias statistic 0.8 to 1.25, each structured estimatortracking error 78.9 to 83.6, bias 1.48 to 1.85Not met
E7Forced turnover less than a third of the total, Ledoit-Wolf path2.99 of 26.26 per cent a year, 11.4 per centMet
E8The three terms sum to the active return, and allocation is the largest in absolute value and interaction the smallest, each structured estimatorlargest gap 9.6e-17, allocation 16.4 to 16.7, selection 10.6 to 13.8, interaction 1.5 to 2.2 bp a monthMet
E9Contributions and residual sum to the active return, and the mean exposure to the market within 0.05 of zero on every pathlargest gap 8.7e-19, exposure −0.0006 to +0.0001Met

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, January 1926 to December 2024, US large caps, USD.

Whether the rebuilt benchmark and the four covariance matrices are what they claim to be.

The universe in a month is the stocks on CRSP's list of index members on the last trading day of the month before, each weighted by its market capitalisation at the start of the month. A delisting is applied as Shumway (1997)4 proposes, and a member's sector is the GICS sector in force on the same day, through CRSP's link to Compustat. The index as S&P publishes it is not the benchmark: its total return is not in the extraction, and its float adjustment cannot be rebuilt from CRSP's share counts.

Table 2 | The benchmark's checks, January 1926 to December 2024

The benchmark against CRSP's own figures and the universe's sorts against French's, with the conditioning of the covariance matrices.

MeasureFigurePeriod
Benchmark against CRSP's value-weighted return, with dividends11.5 bp a yearJanuary 1926 to December 2024
The same, price-only11.6 bp a yearJanuary 1926 to December 2024
The same, with dividends, over the mandate's window15.2 bp a yearJuly 1999 to December 2024
Benchmark's price return against the index's own, no verdict93.6 bp a yearto December 2004
The same, from January 2005, when the index weights by float22.4 bp a yearJanuary 2005 to December 2024
Member-months in the universe440,724January 1926 to December 2024
Momentum spread against French's: correlation0.8881,172 months from January 1927
Momentum: mean monthly difference (standard error)−10.4 (9.0) bp
Variance spread against French's: correlation0.954417 months from April 1990
Variance: mean monthly difference (standard error)2.7 (9.4) bp
Months with the sample condition number at least 10 times the Ledoit-Wolf one86 of 306all from 2017
The same with one share class for each company, no verdict30 of 306all from 2020 to 2022

The months in which the sample matrix's condition number reaches ten times the Ledoit-Wolf one have a cause found after the run: from 2014 the universe holds up to five companies with two share classes each, whose daily returns move almost together, and the difference between two such classes sets the sample matrix's smallest eigenvalue.

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, January 1926 to December 2024, US large caps, USD.

Table 3 | The condition numbers of the four covariance matrices by year, July 1999 to December 2024

The median over each year's months. A larger number means small errors in the matrix become larger errors in the weights an optimiser builds on it.

YearSampleLedoit-WolfFactorPrincipal-componentSample over Ledoit-Wolf
19998,1761,7007147564.8
20008,6091,6266587235.3
200110,8062,1427898475.0
200214,4852,8261,1511,1745.1
200321,5804,4821,4211,4384.8
200426,9285,0541,7221,7775.3
200523,2124,3411,6111,6415.3
200611,4963,0661,0081,0883.7
200711,3872,8889091,0383.9
200816,7193,7371,2411,3744.5
200953,5368,5373,5114,3376.3
201055,50510,1773,7084,6555.5
201171,00010,6333,8444,7186.7
201247,28513,3882,9553,3973.5
201336,14211,1672,5102,7443.2
201431,8419,2922,2032,3623.4
201518,9695,3641,3831,3203.5
201636,1196,5731,6821,7235.5
201766,4896,0671,6621,75711.0
201869,9344,9471,5731,67214.1
201990,0504,1851,1221,14021.5
2020380,9064,9962,7242,44576.2
2021307,9455,3652,7982,58057.4
2022171,8755,8503,3403,29929.4
202394,6797,8702,0142,13212.0
2024101,7959,3411,7251,96110.9

Source: CRSP via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, each from three years of daily returns, July 1999 to December 2024, US large caps, USD.

How much tracking error each estimator forecast and realised under the mandate, what the turnover cap buys and what the turnover is made of.

Each month the mandate chooses the weights that make the forecast tracking error as small as its constraints allow. Twenty-four paths run from the benchmark over the 306 months: the four estimators under four cumulative constraint sets at the 2 per cent cap, and the Ledoit-Wolf and factor estimators under the mandate at four further caps. Under the first three sets nothing pushes the portfolio off the benchmark, and it stays there in every month. The figures below are the twelve paths under the mandate.

Figure 2 | Realised and forecast tracking error by year, the Ledoit-Wolf estimator under the mandate, 1999 to 2024

The tracking error realised in each calendar year and the mean of that year's monthly forecasts, in basis points a year. The year 1999 holds six months.

The realised tracking error runs from 33 basis points a year in 2013 to 176 in 2008, when the mean forecast was 101. The realised tracking error is above the mean forecast in 22 of the 26 calendar years, and not in 2009, 2010, 2011 and 2013, so the understatement is not confined to one crisis.

Simulated. Monthly rebalancing. Before fees. The realised figure of a year is the standard deviation of its monthly active returns, times the square root of 12.

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

Figure 3 | Tracking error against chosen turnover at five caps, the Ledoit-Wolf and factor estimators under the mandate, July 1999 to December 2024

For each estimator and each cap on chosen turnover (0.5, 1, 2 and 4 per cent a month, and none): the realised (filled) and mean forecast (hollow) tracking error in basis points a year, against the chosen turnover in per cent a year. The dots of each estimator run from the tightest cap on the left to no cap on the right.

E5 is not met. On both estimators the mean forecast falls as the cap loosens, from 64.5 to 54.1 basis points a year on Ledoit-Wolf and from 46.6 to 45.0 on the factor estimator. The realised tracking error at the 4 per cent cap is 79.6 on the factor estimator, below its 83.3 at 0.5 per cent, and 79.0 on Ledoit-Wolf, above its 76.3. On Ledoit-Wolf chosen turnover runs from 6.3 to 59.4 per cent a year across the caps while the realised tracking error stays between 76.3 and 79.4. The factor estimator chooses at most 14.9 per cent a year, and the 2 per cent cap binds on it in 13.7 per cent of months, against every month on Ledoit-Wolf. In a month where the other constraints need more chosen turnover than the cap allows, the cap gives way to the least turnover they need. This happens in the first month of every capped path under the mandate, July 1999, when the portfolio leaves the benchmark for the mandate and needs 6.41 per cent, and in 6 further months at the 0.5 per cent cap on the Ledoit-Wolf estimator and 3 on the factor estimator. So on the Ledoit-Wolf estimator at caps of 0.5, 1 and 2 per cent, where the cap binds in every month, chosen turnover a year lies a little above twelve times the cap.

Simulated. Monthly rebalancing. Before fees. Chosen turnover is one-way and excludes the turnover that index changes force.

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

Table 4 | The twelve paths under the mandate, July 1999 to December 2024

Tracking error, active return and its standard error in basis points a year. Turnover one-way, in per cent a year.

PathRealised tracking errorMean forecastBias statisticActive return, grossNewey-West standard errorActive return, net at 10 bpTotal turnover, % a yearChosen turnover, % a yearNames held, mean
Sample, cap 2 per cent80.652.81.60+13.718.6+11.126.324.2375
Ledoit-Wolf, cap 2 per cent78.955.21.48+12.718.2+10.126.324.2388
Factor, cap 2 per cent80.545.11.85+8.717.5+7.115.113.2473
Principal-component, cap 2 per cent83.648.01.73+0.217.4−1.719.317.3459
Ledoit-Wolf, cap 0.5 per cent76.364.51.26+7.217.2+6.38.86.3427
Ledoit-Wolf, cap 1 per cent78.458.31.39+13.418.2+11.914.612.2404
Ledoit-Wolf, cap 4 per cent79.054.31.52+10.118.3+5.447.445.7383
Ledoit-Wolf, cap none79.454.11.53+11.318.9+5.261.059.4381
Factor, cap 0.5 per cent83.346.61.82+7.217.5+6.38.66.2474
Factor, cap 1 per cent82.345.31.85+8.717.6+7.412.610.5474
Factor, cap 4 per cent79.645.01.85+8.417.5+6.716.514.6473
Factor, cap none79.645.01.85+8.517.5+6.816.714.9473

Simulated. Monthly rebalancing. Gross of fees. The net active return is the gross less a trading cost of 10 basis points per unit of one-way turnover, forced turnover included. No active return is beyond one Newey-West standard error of zero.

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

Table 5 | What the turnover is made of, July 1999 to December 2024

One-way turnover in per cent a year, split into the part index changes force, the part that follows the benchmark's own reweighting and the part the optimiser chooses. The three parts less their overlap equal the total.

PathTotalForcedReweightingRebalancingOverlap
The benchmark held (Ledoit-Wolf under C0)5.782.803.710.000.73
Ledoit-Wolf, mandate at 2 per cent26.262.993.6724.945.34
Sample, mandate at 2 per cent26.293.003.6725.135.51
Factor, mandate at 2 per cent15.142.883.6511.913.31
Principal-component, mandate at 2 per cent19.292.933.6916.483.82

E7 is met. On the Ledoit-Wolf path forced turnover is 2.99 per cent a year of a total of 26.26, or 11.4 per cent, below the third fixed before the run. A portfolio that holds the benchmark turns over 5.78 per cent a year: forced turnover 2.80, reweighting 3.71 and no rebalancing.

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

Where the mandate's active return came from, by sector and by factor.

Each month the active return of the four paths at the 2 per cent cap is split by the twelve sectors with the method of Brinson and Fachler (1985)2 into allocation, selection and interaction, which sum to it exactly, and by six factors into contributions and a residual. Both sides are taken over the month's names with a return. A sector with no stock above a weight of one millionth has a selection of zero and keeps the rest of its part as interaction. The monthly terms are summed over months with no geometric linking.

Figure 4 | Allocation and selection by sector over the window, the Ledoit-Wolf path under the mandate, July 1999 to December 2024

Each sector's allocation and selection as annual averages, in basis points a year, each with a bar of two Newey-West standard errors on each side.

On this path the active return of 12.7 basis points a year splits into allocation 1.4, selection 11.3 and interaction 0.0, with Newey-West standard errors of 15.9, 14.0 and 2.0. In Energy and Utilities, the two tilted sectors, selection is within a tenth of a basis point a year of zero: the tilt caps each stock at half its benchmark weight, the cap binds on 19,431 of the 19,433 stock-months in the two sectors on this path, and a sector whose stocks all sit at the same fraction of their benchmark weights earns the benchmark sector's return. Their allocation is 1.0 and 2.9 basis points a year, on standard errors of 13.4 and 4.2. On this path 3 of the 36 sector terms, interaction included, which the figure does not show, lie two standard errors or more from zero, and 1 to 4 on the other paths, against, at the 5 per cent level, 1.8 on average if the tests were independent.

Simulated. Monthly, summed arithmetically. Gross of fees. Interaction is in the table.

Source: CRSP and Compustat via Wharton Research Data Services and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

Table 6 | The three terms over the window, four paths under the mandate at the 2 per cent cap, July 1999 to December 2024

Annual averages with Newey-West standard errors, and E8's mean absolute monthly terms, each month's figure the sum over the twelve sectors.

PathAllocation, bp a yearStandard errorSelection, bp a yearStandard errorInteraction, bp a yearStandard errorAllocation, mean absolute, bp a monthSelection, mean absolute, bp a monthInteraction, mean absolute, bp a monthSector-months not held
Ledoit-Wolf+1.415.9+11.314.00.02.016.5613.811.7616
Sample, no verdict+1.316.1+12.314.7+0.12.216.6314.371.8622
Factor+5.516.3+4.09.3−0.81.516.7410.631.500
Principal-component+3.515.4−3.99.6+0.62.516.4112.332.210

E8 is met. The three terms sum to the active return in every month of the four paths, and on the three structured estimators allocation is the largest in absolute value and interaction the smallest. A sector is not held in 22 months on the sample estimator's path and in 16 on the Ledoit-Wolf path, all of them from 2022, and 66 member-months have no return and are left out of both sides.

Source: CRSP and Compustat via Wharton Research Data Services and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

Table 7 | The factor attribution, four paths under the mandate at the 2 per cent cap, July 1999 to December 2024

Contributions, their sum, the residual and the active return in basis points a year, each with its plain standard error in brackets, the factor share in per cent and the mean active exposures.

Ledoit-WolfSampleFactorPrincipal-component
Market, contribution−1.7 (0.5)−1.6 (0.5)−1.4 (0.5)−1.2 (0.7)
Size, contribution+0.7 (1.2)+0.6 (1.2)+0.9 (1.2)+2.1 (1.9)
Value, contribution−2.0 (2.5)−1.9 (2.5)−1.8 (1.5)−5.4 (4.6)
Profitability, contribution−4.7 (3.5)−4.9 (3.4)−2.3 (2.4)−6.5 (5.5)
Investment, contribution−1.3 (1.5)−1.1 (1.5)−0.8 (1.3)−1.7 (2.5)
Momentum, contribution−0.8 (2.2)−0.7 (2.1)0.0 (1.7)+0.7 (1.8)
The six together−9.7 (4.4)−9.6 (4.4)−5.4 (3.3)−12.0 (5.7)
Residual+22.4 (14.9)+23.4 (15.3)+14.1 (15.8)+12.3 (15.4)
Active return+12.7 (15.6)+13.7 (16.0)+8.7 (15.9)+0.2 (16.5)
Factor share, per cent8.98.62.112.9
Market, mean active exposure−0.0006−0.0006+0.0001−0.0002
Size, mean active exposure+0.0055+0.0053+0.0054+0.0056
Value, mean active exposure−0.0068−0.0067−0.0019−0.0100
Profitability, mean active exposure−0.0071−0.0071−0.0041−0.0162
Investment, mean active exposure+0.0045+0.0047+0.0006+0.0002
Momentum, mean active exposure−0.0028−0.0028−0.0023−0.0018

E9 is met. Contributions and residual sum to the active return in every month, and the mean active exposure to the market factor lies between −0.0006 and +0.0001 on the four paths. On the Ledoit-Wolf path the six contributions sum to −9.7 basis points a year and the residual to 22.4. The standard errors of this table are the plain ones the copied attribution computes, with no allowance for correlation from one month to the next.

Source: CRSP and Compustat via Wharton Research Data Services, Kenneth R. French Data Library and author's calculations. Monthly, July 1999 to December 2024, US large caps, USD.

The data, what is known at each date, the costs, what the study cannot show, and the terms.

Method

Data and access. CRSP and Compustat via Wharton Research Data Services, accessed through Queen Mary University of London, from an extraction of 28 September 2026. They are licensed, and the repository holds none of them: it holds code, tests, the extraction's SHA-256 and aggregate tables.5 Nothing that reproduces CRSP's index file is committed by month, and no weight of a security or of a sector of the portfolio is committed in any form. Kenneth R. French's files are downloaded at run time.

What is known at each date. Membership, sector and capitalisation are read on the last trading day of the month before. Each covariance matrix uses the three years of daily returns before the month. Nothing from the month itself enters a weight.

Rebalancing and costs. Monthly. The turnover cap applies to chosen turnover, measured from the portfolio left after last month's returns with leavers sold and entrants bought at their benchmark weight. Returns are gross of fees. A trading cost of 10 basis points per unit of one-way turnover is charged where stated, forced turnover included.

What the study cannot show. It is a simulation. The benchmark weights CRSP's list by full capitalisation, and the index weights by float. A GICS sub-industry is wider than a list of controversial weapons. Costs are proportional to turnover, with no market impact. Sectors exist from July 1999, so the mandate starts there. No active return is distinguishable from zero, so the study makes no claim about a return the mandate earns.

Where each exhibit comes from

The committed tables each exhibit is drawn from, each linked on GitHub at the commit that last changed it, and the notebooks that write them.

ExhibitCommitted tablesWritten by
Figure 1 | Forecast and realised tracking error under the mandate, four covariance estimators, July 1999 to December 2024paths_summary.jsonnotebook 09
Table 1 | The four gates and nine expectations, fixed before each run, and what the run foundverdicts_milestone1.json, verdicts_milestone2.json, verdicts_milestone3.json, verdicts_milestone4.json, src/slt/constants.pynotebook 04, notebook 06, notebook 07, notebook 09, notebook 10, notebook 11
Table 2 | The benchmark's checks, January 1926 to December 2024reconstruction_summary.json, universe_summary.json, answer_key_summary.json, covariance_summary.jsonnotebook 02, notebook 04, notebook 06, notebook 07
Table 3 | The condition numbers of the four covariance matrices by year, July 1999 to December 2024covariance_by_year.csvnotebook 07
Figure 2 | Realised and forecast tracking error by year, the Ledoit-Wolf estimator under the mandate, 1999 to 2024paths_by_year.csvnotebook 09
Figure 3 | Tracking error against chosen turnover at five caps, the Ledoit-Wolf and factor estimators under the mandate, July 1999 to December 2024paths_summary.json, cap_relaxed.csvnotebook 09, notebook 10
Table 4 | The twelve paths under the mandate, July 1999 to December 2024paths_summary.jsonnotebook 09
Table 5 | What the turnover is made of, July 1999 to December 2024paths_summary.json, verdicts_milestone3.jsonnotebook 09, notebook 10
Figure 4 | Allocation and selection by sector over the window, the Ledoit-Wolf path under the mandate, July 1999 to December 2024brinson_summary.json, tilt_cap.csvnotebook 11
Table 6 | The three terms over the window, four paths under the mandate at the 2 per cent cap, July 1999 to December 2024brinson_summary.json, attribution_counts_by_year.csv, verdicts_milestone4.jsonnotebook 11
Table 7 | The factor attribution, four paths under the mandate at the 2 per cent cap, July 1999 to December 2024factor_attribution_summary.json, verdicts_milestone4.jsonnotebook 11

Terms

universe
the point-in-time S&P 500: the stocks on CRSP's list of index members on the last trading day of the month before.
market capitalisation
price times shares outstanding, at the end of the month before.
benchmark
the cap-weighted universe, each stock's weight its market capitalisation over the universe's total.
active weight
a weight in the portfolio minus the same weight in the benchmark.
active return
the portfolio's return minus the benchmark's, each over the month's names with a return.
cap-weighted
weighted by market capitalisation. CRSP's value-weighted return of the list is the same, computed by CRSP.
value-weighted
cap-weighted.
basis point
a hundredth of a percentage point.
tracking error
the standard deviation of the monthly active return, times the square root of 12. The forecast is the one the month's covariance matrix implies for the month's active weights, the realised the measured one.
covariance matrix
the table of the stocks' variances and of their covariances with each other.
covariance estimator
a way of estimating the covariance matrix from three years of daily returns: the sample covariance, the Ledoit-Wolf estimator6, which shrinks it towards a scaled identity matrix, a factor model on French's five factors and momentum, and a principal-component model with the benchmark as its first factor. The last three are the structured estimators.
eigenvalue
the variance of one of the uncorrelated portfolios a covariance matrix splits into.
condition number
a covariance matrix's largest eigenvalue over its smallest.
band
the range of the bias statistic within which a forecast counts as right, 0.8 to 1.25, fixed before the run.
bias statistic
the standard deviation of each month's active return divided by that month's forecast, over the months with a forecast above one millionth. It is 1 when the forecasts are right on average.
mandate
the full set of constraints the portfolio obeys: long-only, each stock and each company within 50 basis points of its benchmark weight, each untilted sector within 2 percentage points, chosen turnover capped, the tilt, two sub-industries excluded and a beta of one to the benchmark.
beta
the slope of a return on the benchmark's return.
tilt
every Energy and Utilities stock capped at half its benchmark weight.
constraint set
one of the cumulative sets C0 to C3: long-only, plus the bounds per stock, company and sector, plus the turnover cap, plus the rest of the mandate.
path
one covariance estimator under one constraint set at one turnover cap, run month by month from the benchmark.
turnover
a month's one-way trading as a share of the portfolio. Forced turnover is what index changes require, chosen turnover the rest.
turnover cap
the limit on chosen turnover, 2 per cent of the portfolio a month in the mandate, with 0.5, 1 and 4 per cent and no cap on the frontier.
reweighting
the turnover that following the benchmark's own changes in share counts and its dividends takes.
rebalancing
the optimiser's own moves. The overlap is the trades of one step that the next undoes.
Newey-West standard error
the standard error of a mean that allows each month to be correlated with the next twelve. A plain standard error makes no such allowance.
attribution
a split of the active return into parts that sum to it.
allocation
the part of the active return from holding a sector at another weight than the benchmark's: the sector's active weight times the benchmark sector's return less the benchmark's.
selection
the part from holding other stocks within a sector: the sector's benchmark weight times the portfolio sector's return less the benchmark sector's.
interaction
the sector's active weight times that same difference.
Unclassified
the twelfth sector, the members with no GICS sector, one to three securities a month.
factor
a common source of return: the market, size, value, profitability and investment factors of Fama and French (2015), and momentum.
loading
a stock's sensitivity to a factor, from a regression of its daily returns on the six factors over the three years before the month.
active exposure
the members' loadings on a factor weighted by the active weights. A factor's contribution is its active exposure times its return, the residual the active return less the contributions, and the factor share one minus the residual's variance over the active return's.
Sharpe ratio
in the card of Optimal versus naive diversification below, a portfolio's mean return above the one-month Treasury bill rate, over its standard deviation.
look-ahead
the use, in a decision dated at one time, of data published only later.
gate
a test of the data fixed in advance, which stops the study if not met.
expectation
a test of a result fixed in advance, reported as a finding whether met or not.

Notes

  1. Kenneth R. French Data Library: the files of the five factors and momentum, and of the portfolios formed on size and momentum and on size and variance.
  2. Brinson, G. P. and Fachler, N. (1985). Measuring non-U.S. equity portfolio performance. Journal of Portfolio Management 11(3), 73 to 76. https://doi.org/10.3905/jpm.1985.409005
  3. Fama, E. F. and French, K. R. (2015). A five-factor asset pricing model. Journal of Financial Economics 116(1), 1 to 22. https://doi.org/10.1016/j.jfineco.2014.10.010
  4. Shumway, T. (1997). The delisting bias in CRSP data. Journal of Finance 52(1), 327 to 340. https://doi.org/10.1111/j.1540-6261.1997.tb03818.x
  5. The repository: the notebooks, the tables committed in results/20260928/ and the constants fixed before each run.
  6. Ledoit, O. and Wolf, M. (2004). A well-conditioned estimator for large-dimensional covariance matrices. Journal of Multivariate Analysis 88(2), 365 to 411. https://doi.org/10.1016/S0047-259X(03)00096-4

Other projects

Optimal versus naive diversification. Under an index-tracking mandate on French's 49 industries, five covariance estimators understate their own tracking error, by 22 to 61 per cent. The replication of DeMiguel, Garlappi and Uppal (2009) reproduces 29 of the 30 Sharpe ratios that carry a band. Page, dashboard, note, code

Climate risk as an equity signal. An ownership graph linking 328 listed companies to the 5,115 tracked assets they own. Of 19 apparent ownership changes checked by hand, 12 had no transaction behind them. Page, note, code

Volatility-managed portfolios: a replication, the real-time critique, and the months after the sample. Volatility estimation and position sizing on Ken French's equity factors, backtested out of sample and without look-ahead, replicating Moreira and Muir (2017) and Cederburg, O'Doherty, Wang and Yan (2020). Scaled by the inverse of last month's realised variance, a factor has a Sharpe ratio above the original's beyond its 95 per cent interval for one of six factors, momentum, and the 136 months after Moreira and Muir's sample cannot tell any difference from zero. Page, dashboard, note, code

Rules-based portfolio. Runs a real-money portfolio under rules published before the first order: two UCITS ETFs at 70/30, a monthly cycle with pre-trade checks, look-through exposure and ex-ante risk on a public dashboard. Page, dashboard, guide, code