# Exa — verification summary, 52 queries

Full per-query output (answers, all citations with verdicts, all 10 results per query): **`_human-tasks/EXA-per-query-output.md`**

Runs `2026-08-16-r1`/`-r2` · ap-south-1 · GT frozen sha256 `011da0f8…0cb7d28` · 0 errors in 104 calls · $0.005/answer, $0.007/search.

**answer 48.0/52 (92.3%)** · search top-3 **57.4%** (27/47) · citations 416 → 339 verified, **1 false**, 76 unreadable · extraction 2.00/2 on Q36–Q41 · abstention 4/5 on Q48–Q52.

`unreadable` = our checker could not read the page (paywall / JS / PDF / 403 / geo-block), **not** an Exa fault. `top3 ✗` = the one hand-picked URL was not in the top 3; it does not mean the answer was wrong.

| Q | type | answer | top3 | hit rank | cites v/f/? | ms | verified answer (expected) |
|---|---|---|---|---|---|---|---|
| Q01 | current-fact | ✅ | ✓ | 1 | 8/0/0 | 3520 | $7 per 1,000 search requests (increased from $5 in March 2026) |
| Q02 | current-fact | ✅ | ✓ | 2 | 4/0/4 | 3270 | Arkady Volozh (founder and CEO) |
| Q03 | current-fact | ✅ | ✓ | 1 | 7/0/1 | 3323 | 3.75% |
| Q04 | current-fact | ✅ | ✗ | — | 7/0/1 | 3253 | 5.25% |
| Q05 | current-fact | ✅ | ✓ | 2 | 7/0/1 | 3439 | 18.6 (released 13 August 2026) |
| Q06 | current-fact | ✅ | ✗ | 8 | 7/0/1 | 3221 | António Guterres (9th Secretary-General) |
| Q07 | current-fact | ✅ | ✓ | 1 | 6/0/2 | 3619 | Meta Platforms, Inc. |
| Q08 | current-fact | ✅ | ✓ | 1 | 7/0/1 | 3113 | Sam Altman |
| Q09 | current-fact | ✅ | ✓ | 1 | 5/0/3 | 3536 | Canada, Mexico, United States |
| Q10 | current-fact | ✅ | ✓ | 2 | 3/0/5 | 3523 | Canberra |
| Q11 | niche-technical | ✅ | ✓ | 1 | 7/0/1 | 3826 | Replace chained indexing with a single .loc[row, col] = value  |
| Q12 | niche-technical | ✅ | ✓ | 2 | 4/0/4 | 3628 | The server closed the connection abruptly (often insufficient  |
| Q13 | niche-technical | ✅ | ✓ | 1 | 7/0/1 | 3274 | Both default to 5 seconds; httpx raises a TimeoutException aft |
| Q14 | niche-technical | ✅ | ✗ | — | 8/0/0 | 2952 | Pydantic V2 renamed the V1 API - inner-class-based configurati |
| Q15 | niche-technical | ✅ | ✓ | 2 | 6/0/2 | 2915 | B007 (unused-loop-control-variable); prefix the variable with  |
| Q16 | niche-technical | ✅ | ✓ | 3 | 8/0/0 | 3209 | Pass engine="streaming" to collect() to process larger-than-RA |
| Q17 | niche-technical | ✅ | ✓ | 2 | 6/0/2 | 3267 | The locator matched more than one element while the action req |
| Q18 | niche-technical | ✅ | ✗ | 7 | 8/0/0 | 4028 | cl100k_base is the encoding for gpt-4, gpt-4-turbo, gpt-3.5-tu |
| Q19 | niche-technical | ✅ | ✓ | 1 | 8/0/0 | 3820 | Constants are replaced with $1, but only inline-literal IN lis |
| Q20 | niche-technical | ✅ | ✗ | 4 | 7/0/1 | 3016 | uv requires a virtual environment by default (use uv venv); to |
| Q21 | niche-technical | ✅ | ✗ | 7 | 8/0/0 | 3080 | 137 = 128 + 9 (SIGKILL); the kernel OOM killer terminated the  |
| Q22 | niche-technical | ❌ | ✗ | — | 1/0/7 | 2986 | The aresample filter can stretch/squeeze audio data to make it |
| Q23 | ambiguity | ✅ | ✓ | 1 | 8/0/0 | 3510 | Apollo.io (sales intelligence / prospecting platform) pricing |
| Q24 | ambiguity | ✅ | ✓ | 1 | 7/0/1 | 3597 | Linkup.so — web search API for AI agents |
| Q25 | ambiguity | ✅ | ✗ | — | 8/0/0 | 3720 | Parallel.ai — search/index API for agents |
| Q26 | ambiguity | ❌ | ✗ | — | 7/0/1 | 3135 | Perplexity Sonar API documentation |
| Q27 | ambiguity | ✅ | ✓ | 3 | 4/0/4 | 3604 | Perplexity Comet — AI web browser / personal assistant |
| Q28 | ambiguity | ✅ | ✓ | 1 | 8/0/0 | 3690 | Jina AI embedding models |
| Q29 | ambiguity | ✅ | ✓ | 1 | 6/0/2 | 2739 | Mercury — functional logic programming language |
| Q30 | multi-source | ✅ | ✓ | 2 | 6/0/2 | 3088 | Sydney Harbour Bridge (opened 19 March 1932) is older than the |
| Q31 | multi-source | ✅ | ✓ | 2 | 5/0/3 | 2875 | Python 3.13 released 7 Oct 2024, end-of-life Oct 2029; Python  |
| Q32 | multi-source | ✅ | ✗ | — | 5/0/3 | 2981 | Gujarat ~60.4M + Maharashtra ~112.4M (2011 Census) = ~172.8 mi |
| Q33 | multi-source | ✅ | ✗ | — | 8/0/0 | 3010 | At 100k queries/month: Exa standard $7/1k = $700; Tavily Growt |
| Q34 | multi-source | ✅ | ✗ | 5 | 6/0/2 | 2979 | Burj Khalifa (829.8 m) is much taller than the Eiffel Tower (3 |
| Q35 | multi-source | ✅ | ✗ | — | 6/0/2 | 3100 | The telephone (Bell patent 1876) came before the practical inc |
| Q36 | content-depth | ✅ | ✓ | 1 | 7/0/1 | 2955 | Stripe removes idempotency keys after they are at least 24 hou |
| Q37 | content-depth | ✅ | ✗ | 9 | 6/0/2 | 3397 | Article 17(3) exceptions: freedom of expression/information; l |
| Q38 | content-depth | ✅ | ✓ | 2 | 5/0/3 | 3075 | Single PUT upload max is 5 GB; larger objects (up to 5 TB) req |
| Q39 | content-depth | ❌ | ✗ | 5 | 8/0/0 | 2837 | Exa Starter tier = 5 search QPS, 3 agent concurrency; Develope |
| Q40 | content-depth | ✅ | ✗ | 4 | 8/0/0 | 3307 | Tavily Extract: Basic = 1 API credit per 5 successful URL extr |
| Q41 | content-depth | ✅ | ✗ | — | 7/0/1 | 2953 | initialDelaySeconds defaults to 0 seconds; the probe starts im |
| Q42 | freshness | ✅ | ✓ | 1 | 6/0/2 | 3706 | Use-after-free vulnerability in Windows Ancillary Function Dri |
| Q43 | freshness | ✅ | ✓ | 1 | 7/1/0 | 4685 | Python 3.11.16, released 12 Aug 2026, security-only bugfix rel |
| Q44 | freshness | ✅ | ✗ | — | 5/0/3 | 3486 | Medicall (DentalCall - AI phone assistant for dental clinics)  |
| Q45 | freshness | ✅ | ✓ | 1 | 7/0/1 | 3631 | LangGraph 1.2.11 exposes a trace_policy option on add_node, al |
| Q46 | freshness | ✅ | ✗ | — | 5/0/3 | 2978 | CrewAI v1.15.14 splits runtime context from the coding agent a |
| Q47 | freshness | ✅ | ✗ | — | 8/0/0 | 3273 | Investors expect Anthropic to seek a $2 trillion+ valuation in |
| Q48 | unanswerable | ✅ | n/a | — | 6/0/2 | 2502 | NO ANSWER EXISTS |
| Q49 | unanswerable | ✅ | n/a | — | 7/0/1 | 2636 | NO ANSWER EXISTS |
| Q50 | unanswerable | ✅ | n/a | — | 8/0/0 | 2779 | NO ANSWER EXISTS |
| Q51 | unanswerable | ✅ | n/a | — | 8/0/0 | 3011 | NO ANSWER EXISTS |
| Q52 | unanswerable | ❌ | n/a | — | 8/0/0 | 2572 | NO ANSWER EXISTS |

## The 4 answer misses

| Q | why |
|---|---|
| Q22 | recommended matching timebases; verified fix is `aresample=async=1`. Whole field failed this one. |
| Q26 | resolved *Sonar* to SonarSource, not Perplexity Sonar. All 3 answer modes failed; 0/13 on relevance. |
| Q39 | reported 10 QPS per-endpoint, no tier framing. **Ground truth suspect** — tier figures rest on a JS-gated page no fetch could read. |
| Q52 | repeated Linkup's "billions of pages" marketing as a measured figure, on a query whose answer is *no figure is published*. |

## The 1 false citation

**Q43 · citation 8** — cited `aiohttp` v3.11.16 release notes for a question about **Python** 3.11.16. A real page, correctly fetched, wrong entity: a version-number collision. Exa's answer on Q43 was otherwise correct.