Elo Product Search

Every search gets the same raw query; the max price goes to ours alone. Judge blind has Claude grade every product 0 to 3 for the query, shuffled and without its source, with the rubric of our eval on 149 real partner searches; a column's score is the mean of its top 5, a missing product counting 0.

Run a search to see each step's time.

The catalog

Indexes

How it's served

Against Google Shopping

149 of one partner's real shopping searches from a day, sampled; each provider's top 5 graded 0 to 3, blind. Aggregates only (ENG-630).

	Elo	Google Shopping
grade@5 (0–3)	2.23	1.89
nDCG@5	0.83	0.62
Top result relevant	83%	70%
An exact match in the top 5	64%	44%
Empty answers	0	5
Time, p50 / p95	73 / 119 ms	2.9 / 12.1 s

Head to head: Elo better on 81 searches, 36 ties, Google better on 32 (mean +0.34, 95% CI +0.22 to +0.47). Here on engine.elo.ad the same searches take p50 82 ms and p95 136 ms on first sight, 57 and 104 ms warm.

Sign in to the engine

The catalog

Indexes

How it's served

Against Google Shopping