The world is being quietly rearranged by people who write very long documents.


The title they went with Mosaics of Predictability Noisy translates that to

Fifty years of data just broke the random walk theory.

The financial models designed to capture market behavior ignored the specific conditions where the market is actually predictable.

For fifty years, the baseline assumption in finance was that stock returns are mostly random and predictability is a statistical illusion. This paper ends that default. The predictability was just hiding in specific corners: illiquid stocks, high earnings-price ratios, and economic downturns. The bet is that quantitative funds will integrate these specific mosaic patterns to hunt for alpha in the exact places conventional models ignore. Watch for a shift in quant strategies explicitly targeting low-volume equities during the next liquidity crunch.
It turns out that stock market returns are not randomly predictable. Instead, predictability concentrates in specific kinds of stocks, like those with big earnings surprises, high earnings-to-price ratios, and low trading volume. This means investors can use these patterns to make better forecasts and build portfolios that perform better.
2 out-of-sample Sharpe ratios
50 years data collected
assumed Many investors assumed that stock market movements were mostly random, or that any predictability was too small to matter.
found Stock market returns are not randomly predictable; instead, predictability concentrates in specific kinds of stocks and is stronger during economic downturns.
For half a century, the smartest people in finance told you the stock market was a random walk. It turns out they were just looking at the wrong map. Predictability exists. It just hides in the boring, illiquid stocks when the economy is doing poorly.
The dominant financial theory of the last half-century says the market cannot be predicted. Fifty years of market data says it can.
Quantitative investors Quantitative investors who quietly build portfolios around low-volume, high-surprise stocks during market downturns.
Efficient market purists Conventional indexers who built their entire worldview on the assumption that market returns are perfectly random.
Financial modelers Anyone running a forecasting model that treats the entire US equity panel as a single, uniform entity.
Panel Tree a statistical model that divides data into groups to find patterns
Sharpe ratios a measure of an investment's return compared to its risk
People ignore this paper because it is buried in academic jargon about endogenous partitions. That changes the second a fifty-billion-dollar hedge fund uses these formulas to generate returns during a recession. Quant funds will soon quietly tweak their models to buy low-volume, high-surprise stocks when the market contracts. Passive index managers will brush this off as data mining. They have to do this because admitting markets are structurally predictable ruins the premise of their twenty-trillion-dollar industry.
For fifty years, the Efficient Market Hypothesis insisted that traders would immediately arbitrage away any predictable patterns. This paper maps exactly where that half-century rule breaks down. It fits a five-year academic trend of dismantling the old theories. Researchers are now using thousands of GPUs to find localized, state-dependent pricing failures.

If you insist
Read the original →

The Sendoff
Stock market predictability is strongly countercyclical, peaking precisely when overall market liquidity is at its lowest. The absolute best time to predict the stock market is when you have no money to invest in it.