Can Agents Run It? · Issue 2 · Evidence
Evidence
Everything behind the numbers on the main page, from the run records.
Which store the models pick
All 125 answers: the five prompts, every answer in full with the code it generated, and how each one was counted.
The jobs
For every attempt: the code and state the agent left, every command it ran, what it said at the end and the grader's verdict.
| Job | Server | Passed |
|---|---|---|
| Cache in front of a slow service | Valkey 9.1 | 15 of 15 |
| Cache in front of a slow service | Redis 8.10 | 15 of 15 |
| Semantic search inside the server | Valkey 9.1 | 15 of 15 |
| Semantic search inside the server | Redis 8.10 | 15 of 15 |
| Move production data off Redis 7.2 | Valkey 9.1 | 15 of 15 |
| Move production data off Redis 7.2 | Redis 8.10 | 15 of 15 |
| Move production data off Redis 8.10 (wave 2) | Valkey 9.1 | 11 of 15 |