ExecRetrieval: Measuring the Functional-Correctness Gap in Code-Embedding Retrieval
Embedding-based code retrieval is a core component of coding agents and retrieval-augmented code generation, where retrieving correct code matters more than retrieving lexically similar code. Existing code-retrieval benchmarks do not plant controlled, execution-verified single-edit variants of each query's canonical implementation in the search pool, leaving the question of whether embeddings can functionally discriminate correct from near-clone-but-incorrect code unanswered in a retrieval setting. Resolving this requires a benchmark whose search pool itself contains the relevant counterfactuals -- execution-verified buggy variants near-identical to each canonical -- so that a retriever's...
| Authors | Aaryan Kapoor, Md Abdullah Al Hafiz Khan |
|---|---|
| Primary category | cs.SE |
| Published | 1 September 2026 |
| Last updated at source | 1 September 2026 |
Connected in the knowledge graph
- AaryanK/ExecRetrievalDataset · cited by
Models and datasets referencing this paper
- AaryanK/ExecRetrievalDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.