Skip to main content
Connect to the hosted server:
The server uses OAuth 2.1. Your browser opens to sign in and approve access, so the MCP configuration holds no API key. Reading evals needs evals:read. Starting a batch needs evals:write.

Eval tools

start_suite_batch and start_case_batch return the batch ID and one run ID per case per variant right away. Poll get_batch until its status is no longer running. start_case_batch runs 1 trial unless you pass trials. list_batches and list_cases return next. Pass it as cursor to read the following page.