Fintech & AIQuant Lab · Quant / Global

AI Algorithmic Trading: Real Uses vs. Marketing Hype

We trained a model to predict the Nasdaq's direction: 90.6% accuracy on the past, 54.3% on the following ten years, less than betting on a rise every day. What AI really brings to trading, and what is marketing.

By Alain LegrandAudited methodologyPublished on · 8 min read

Last methodological review:

#artificial intelligence#algorithmic trading#fintech AI#limitations
AI Algorithmic Trading: Real Uses vs. Marketing Hype

Quantitative Research · Quant Lab

Quant Educator Workbench

Photo : Radiotrefoil — Wikimedia Commons (CC BY-SA 4.0)

Executive Summary

Key Takeaways (TL;DR)

  • With one or two sessions of history, the model merely learns that the market rises more often than it falls: 54.8% accuracy.
  • With 14 sessions, 64.5% of the patterns met during the test had never been seen.
  • Language analysis can read thousands of press releases, earnings-call transcripts or regulatory filings in seconds and extract their tone or changes in wording.
  • Our experiment shows how easy it is to display 90% accuracy on historical data.

A model that "predicts" the Nasdaq's next-day direction with 90.6% accuracy: that is what we obtained, on the training data. Over the following ten years, which the model had never seen, its accuracy drops to 54.3%, less than the naive rule of betting on a rise every day (55.9%). This experiment, run on 36 years of prices, sums up the main limit of artificial intelligence applied to trading, and helps separate its real contributions from its sales pitch.

The experiment: the more flexible the model, the better it learns the past

We used daily closes of the Nasdaq Composite, split into a training period (1990-2015, 6,553 sessions) and a test period (January 2016 to September 2026, 2,696 sessions). The model is deliberately simple: for each sequence of the market's last k directions (up or down), it predicts the next-day direction that was most frequent during training. Increasing k from 1 to 14 increases its flexibility, exactly like adding layers or parameters to a neural network.

Editorial photo: algorithmic modeling and financial analysis
Photo: Markus Winkler (Pexels)

On the training data, the result looks spectacular. With one or two sessions of history, the model merely learns that the market rises more often than it falls: 54.8% accuracy. With 8 sessions, it reaches 59.0%; with 10, 65.9%; with 12, 78.6%; with 14, 90.6%.

Model accuracy by complexity

On training data (1990-2015)On test data (2016-2026)Always betting on a rise
Model accuracy by complexity0 %25 %50 %75 %100 %1361014Number of past sessions used by the model
TrueVerdikt calculation on the Nasdaq Composite (FRED, NASDAQCOM series). The model predicts next-day direction from the last k directions.

Over the test period, however, no setting beats the 55.9% obtained by always betting on a rise. The 3-session model falls to 52.0%, the 8-session one to 51.8%, the 14-session one to 54.3%. Turned into a strategy, investing only on days when the model predicts a rise multiplies capital by 2.6 to 4.8 between 2016 and 2026, versus 5.4 for simply holding the index.

Why markets resist flexible models

Three reasons explain this failure. First, the signal is tiny compared with the noise: daily moves are almost random. Second, data are scarce: with 12 sessions of history, the model must learn 4,096 different patterns from 6,553 sessions, or 1.6 observations per pattern; it memorizes rather than learns. With 14 sessions, 64.5% of the patterns met during the test had never been seen. Finally, markets adapt: a profitable pattern attracts capital that makes it disappear, something that never happens to a cat in a photo.

Final capital from 2016 to 2026: the model versus simply holding

Final capital from 2016 to 2026: the model versus simply holding0×2×4×6×2.62×k = 34.06×k = 44.35×k = 62.91×k = 84.62×k = 104.84×k = 124.6×k = 145.44×Buy-and-hold
Strategy invested only on days when the model predicts a rise, fees not modeled. No version beats holding the Nasdaq Composite.

Where AI delivers real value

AI excels when data are abundant and the problem is stable. Language analysis can read thousands of press releases, earnings-call transcripts or regulatory filings in seconds and extract their tone or changes in wording. Classifying market regimes, calm or turbulent, helps adjust risk rather than predict prices. Order-execution optimization, anomaly detection and automated document processing are other uses where repetition provides enough examples to learn from.

Editorial photo: algorithmic modeling and financial analysis
Photo: Rafael Minguet Delgado (Pexels)

Even in these areas, value is measured the same way: on data the model has never seen, fees included, against a simple alternative.

Validating an AI model before trusting it with capital

  1. 1

    Training

    Past data only

  2. 2

    Separate test

    Never-seen data

  3. 3

    Multi-regime stress

    Crises and calm phases

  4. 4

    Live monitoring

    Degradation detection, retraining

The safeguards described in the article against the perfect-backtest illusion.

Where marketing far outpaces reality

Our experiment shows how easy it is to display 90% accuracy on historical data. An "AI trading bot" presenting a backtest with no test period after its design, no fees and no comparison with simply holding proves nothing. Add to that the black-box problem: when an opaque model loses money, nobody can tell whether it is a bad patch or a model that no longer works.

Editorial photo: algorithmic modeling and financial analysis
Photo: Rafael Minguet Delgado (Pexels)

Interpretability versus performance: a deliberate trade-off

In our test, the simplest models do no worse out of sample than the most complex ones: with 4 sessions, accuracy reaches 53.9%, versus 53.0% with 12 sessions. In finance, where noise dominates, simplicity is often a strength: a model with few parameters fails in more predictable ways, and you understand why it fails. Adding complexity only makes sense if the out-of-sample gain is demonstrated.

Editorial photo: algorithmic modeling and financial analysis
Photo: Rafael Minguet Delgado (Pexels)

The hidden cost of constant retraining

Markets change, so models must be retrained. Each retraining is another chance to pick, among many variants, the one that best fits the recent past: the risk of overfitting builds up with every cycle. On top of that come the costs of infrastructure, data and monitoring model drift, which weigh heavily against modest expected gains.

Editorial photo: algorithmic modeling and financial analysis
Photo : Hugovanmeijeren — Wikimedia Commons (CC BY-SA 3.0)

What a retail investor can reasonably expect

Faced with an AI-based strategy, four questions are enough: do the results cover a period after the model was designed? Are fees included? Does the strategy beat simply holding? How many versions were tried before this one? The backtest analysis tool available on /tools/quant-educator notably computes a Sharpe ratio adjusted for the number of trials, to check that a result is not luck. Method: daily closes of the Nasdaq Composite (NASDAQCOM series from the Federal Reserve Bank of St. Louis), training from 1990 to 2015, test from January 2016 to September 22, 2026, fees not modeled. These results do not constitute investment advice.

Frequently asked questions

Can artificial intelligence predict the stock market?

Not the daily direction of prices, according to our experiment. A model trained on the Nasdaq from 1990 to 2015 reached 90.6% accuracy on that data, but only 54.3% from 2016 to 2026, less than betting on a rise every day (55.9%). AI is more useful for analyzing text, classifying market regimes or optimizing execution.

How can you spot an AI trading bot that promises too much?

Ask for results over a period after the model was designed, fees included, compared with simply holding, and for the number of versions tested. A 90% historical accuracy proves nothing: we obtained it with a few-line model that does not beat the market.

Why does an AI model that succeeds in backtests fail in real trading?

Because it memorizes past noise. In our test, the most flexible model had to learn 4,096 patterns with only 1.6 observations each, and 64.5% of the patterns met afterwards had never been seen. Markets also change regime and arbitrage away the anomalies being exploited.

Quant Lab · Deep Explanations

Quant Educator Workbench

Break down statistical mechanics, model assumptions, and live failure modes behind quantitative systems.

Open Quant Educator
AL

Author & Methodological Lead

Alain Legrand

Founder & Quantitative Financial Engineer · TrueVerdikt

Last methodological review: editorial@trueverdikt.com

Independent financial engineer based in Quebec, Canada, Alain Legrand builds and audits TrueVerdikt's deterministic models: Series A/F mutual fund vs. TSX ETF fee comparisons, RRSP/FHSA tax arbitrage, Canadian mortgage actuarial schedules, and statistical overfitting detection (Deflated Sharpe Ratio & CPCV).

Primary Regulatory & Academic Sources