Korzy vs web search alone: the benchmark
The same AI model answered 20 real site questions with web search alone and with Korzy. Medians from 40 paired runs, November 2026.
- 7 s vs 26 s median; faster in 40 of 40 pairs
- About 4× faster
- ~2,900 vs ~31,600; 1 step vs 6
- 91% fewer tokens
- $0.035 vs $0.071 median, incl. Korzy
- About half the cost
Setup
- 20 point-in-time questions about sites in 11 metro areas across 9 states: parcels, flood and wetlands, power and grid, data centers, logistics, terrain and water service.
- The same AI model and the same prompt answered each question 2 times with web search alone, and 2 times with Korzy’s tools instead.
- That gives 40 paired runs, measured November 2026.
- A separate AI model graded each answer blind, without seeing which tools were used.
Results
| Per question | Web search alone | With Korzy |
|---|---|---|
| Tokens per question (median) | 31,600 | 2,900 |
| Cost per question, all-in (median)Model, web searches and Korzy credits | $0.071 | $0.035 |
| AI model cost per question (median)Model and web searches only, without Korzy credits | $0.071 | $0.003 |
| Time per question (median) | 26 s | 7 s |
| Tool calls per question (median) | 6 | 1 |
| Fully answeredBlind-graded for completeness, not fact-checked | 33% | 63% |
With Korzy the model was faster in 40 of 40 paired runs.
How cost is counted
- Model usage: what the AI model charges, at list price, for the text it reads and writes.
- Web searches: $0.01 a search. Only the web search runs have them.
- Korzy credits: $0.016 each, the Professional rate on our pricing page. The median Korzy run used 2 credits.
- All-in cost adds the three: a median of $0.071 per question with web search alone and $0.035 with Korzy.
- The cost of grading the answers is left out.
Caveats
- A small sample: 20 questions, 2 runs each, one AI model, one day, list prices.
- We chose the questions, at places where Korzy has coverage.
- The Korzy runs had no web search. A real agent would have both.
- Answers were graded for completeness, not checked for accuracy.
- Korzy credits are priced at the Professional rate ($0.016 each). Business credits cost less.