Be the first to get access to new connectors. Get early access →
ConnectorBay Early access

Vapi Testing (BYOK) — connector documentation

  • MCP endpoint: https://byok-vapi-testing.connectorbay.com/mcp
  • REST API: POST https://byok-vapi-testing.connectorbay.com/v1/tools/{tool_name}, described by the OpenAPI 3.1 spec at https://byok-vapi-testing.connectorbay.com/openapi.json
  • Transport: Streamable HTTP, stateless, MCP specification 2025-06-18 or later
  • Authentication: your own Vapi Testing private API key, sent in the X-Upstream-Key header of every request (never stored, logged or cached)
  • Health: https://byok-vapi-testing.connectorbay.com/health · Tool schemas: https://byok-vapi-testing.connectorbay.com/tools.json
  • Publisher: Unify Dynamics LLC · connectorbay.com/byok-vapi-testing · agent@connectorbay.com

What Vapi Testing (BYOK) is for

Vapi Testing (BYOK) lets an AI assistant read your own Vapi Testing data through the Vapi Testing API with a key you supply (private API key). Read-only: 8 tools (list_evals, list_eval_runs, list_simulations, list_simulation_scenarios, list_simulation_personalities, list_simulation_suites, list_simulation_runs, get_simulation_concurrency). The BYOK key travels with each request, is used for that one call only and is never stored, logged or cached; it is only ever sent to api.vapi.ai. Unofficial connector by Unify Dynamics LLC: not affiliated with, endorsed by or sponsored by Vapi Testing. Vapi Testing and its logos are trademarks of their owners and are used only to say which service the connector works with.

Ask your assistant things like:

  • "Which evals have I defined for my Vapi assistants?"
  • "Did my last Vapi eval runs finish and what did they cost?"
  • "Which Vapi simulations do I have and which scenarios do they use?"
  • "What scenarios can I simulate against my Vapi assistant?"
  • "Which tester personalities exist for Vapi simulations?"
  • "Which simulation suites do I have in Vapi?"

What it does

  • list_evals: List eval definitions (mock conversations that check an assistant's behavior) with name, description, type and timestamps.
  • list_eval_runs: List eval runs with status, end reason, target, eval id, start and end time and cost in USD (conversation results are not returned).
  • list_simulations: List simulations (a scenario paired with a tester personality) with name, scenario id, personality id and folder path.
  • list_simulation_scenarios: List simulation scenarios (the script a tester follows) with name, instructions, folder path and timestamps.
  • list_simulation_personalities: List tester personalities used in simulations (your own and Vapi defaults) with name, folder path and timestamps.
  • list_simulation_suites: List simulation suites with name, the simulation ids they contain, assigned assistants or squads and folder path.
  • list_simulation_runs: List simulation runs with status, target, per-status item counts (passed, failed, running, queued), iterations and start and end time.
  • get_simulation_concurrency: Show the organization's simulation concurrency limit, call slots in use and how many voice simulations can start now.

BYOK key

You bring your own Vapi Testing private API key (https://dashboard.vapi.ai). Your assistant sends it in the X-Upstream-Key header with each request. ConnectorBay uses it for that one call only: it is never stored, logged or cached, never shown in an answer, and it is only sent to api.vapi.ai over https, with no redirects followed. Create a key with the fewest permissions the tools need (read-only if the provider offers it), and revoke it at the provider whenever you like.

Notices

Read-only: lists test definitions and results only. It never starts evals, simulations or calls, so it costs nothing.

Data sources

Live from the Vapi Testing API (api.vapi.ai) with a BYOK key; documentation: https://docs.vapi.ai/api-reference/eval/eval-controller-get-paginated. Endpoints checked against that documentation on 2026-10-16.

What it is not

Unofficial connector by Unify Dynamics LLC: not affiliated with, endorsed by or sponsored by Vapi Testing. Vapi Testing and its logos are trademarks of their owners and are used only to say which service the connector works with. It is read-only: it never creates, changes, sends or deletes anything in your Vapi Testing account.

Built for: Worldwide. Languages: English.