Can Agents Run It? · evidence — Issue 1: Supabase

tencent/hy3 · d2_pooling · rep 2

fail
model
tencent/hy3
task
d2_pooling
rep
2
day
2
steps
0
tokens
4,568
est. cost
$0.001
agent time
89s
wave
s4c
started
2026-07-26T02:50:21Z

The task as the agent received it

You have operator access to a hosted Supabase project. Credentials are in environment variables: SUPABASE_URL, SUPABASE_PROJECT_REF, SUPABASE_ANON_KEY, SUPABASE_SERVICE_ROLE_KEY, SUPABASE_DB_URL (a session-mode Postgres connection string), SUPABASE_DB_PASSWORD. Our serverless workers keep exhausting database connections. Write an executable script named pool_smoke.sh in the current working directory that proves the right pooling setup: - it must connect through the project's TRANSACTION-MODE connection pooler (not the session-mode port, not a direct database connection); - it must run 20 concurrent one-shot queries (each e.g. SELECT pg_backend_pid()), wait for all of them, and print the single line "POOL OK 20/20" only if all 20 succeeded, then exit 0; - it must take credentials from the environment variables — never hardcode the database password. Run it yourself to confirm it passes before finishing.

What it ran — 0 commands

How it was graded

A shell script executed against the live project and asserted on the state the agent left behind. No model judged another model.

exit 1 FAIL: pool_smoke.sh not found in the working directory

Check it yourself

Raw transcript · Task definition and verifier · Every attempt