Test and compare AI harness configurations — models, scaffolding, and roles — using your own API key. The key stays in this browser tab, in memory only. The backend only ever receives sanitized run traces: never the key, never the calls.
Sweeps run here in your browser with no backend. Scoring is local-only on purpose —
/score executes model-generated code, so it is not hosted publicly. Clone the
repo and run the backend to get suite scores and the task × config matrix.
stays in this tab, in memory — never sent to the backend
Your key is sent only to the provider host for each substrate
(api.anthropic.com). Below is the entire request this page
posts to the backend — there is no key field in it.
Don't trust this panel. Open your browser's Network tab — that is your own record and we cannot fake it — and read the open-source backend, which refuses any payload that even looks key-shaped.
Run a sweep — this shows the exact payload posted to the backend (no key).
Browser-callability differs by vendor. Anthropic opts in to direct
browser calls, so it works here. api.openai.com does not: it returns no
access-control-allow-origin on the response, so the browser discards it whatever
key you send. Point the openai shape at a compatible endpoint you host instead.
NTAI_TOKEN).A base config plus axes to vary → the full matrix is generated for you.