Be the first to get access to new connectors. Get early access →
ConnectorBay Early access
Discover
Vapi Testing (BYOK) icon

Vapi Testing (BYOK)

Read your Vapi voice agent test setup: evals and eval runs, simulations, scenarios, tester personalities, suites, simulation runs and concurrency with your own private API key

Unify Dynamics LLC

Tools8read-only
Sign-inBYOKbring your own key
Key keptNeverused for one call only
PriceFreeoptional Pro limits
ProviderVapi Testingunofficial, not affiliated
Works withMCP · RESTany agent

Try asking

Real questions, and the tools your agent calls to answer them.

Which evals have I defined for my Vapi assistants?
Tools called
list_evals
Did my last Vapi eval runs finish and what did they cost?
Tools called
list_eval_runs
Which Vapi simulations do I have and which scenarios do they use?
Tools called
list_simulations
What scenarios can I simulate against my Vapi assistant?
Tools called
list_simulation_scenarios
Which tester personalities exist for Vapi simulations?
Tools called
list_simulation_personalities
Which simulation suites do I have in Vapi?
Tools called
list_simulation_suites

About

Vapi Testing (BYOK) lets an AI assistant read your own Vapi Testing data through the Vapi Testing API with a key you supply (private API key). Read-only: 8 tools (list_evals, list_eval_runs, list_simulations, list_simulation_scenarios, list_simulation_personalities, list_simulation_suites, list_simulation_runs, get_simulation_concurrency). The BYOK key travels with each request, is used for that one call only and is never stored, logged or cached; it is only ever sent to api.vapi.ai. Unofficial connector by Unify Dynamics LLC: not affiliated with, endorsed by or sponsored by Vapi Testing. Vapi Testing and its logos are trademarks of their owners and are used only to say which service the connector works with.

Sources: Live from the Vapi Testing API (api.vapi.ai) with a BYOK key; documentation: https://docs.vapi.ai/api-reference/eval/eval-controller-get-paginated. Endpoints checked against that documentation on 2026-10-16.

Privacy

The publisher, Unify Dynamics LLC, states that tool inputs are processed in memory and not retained.

Data not collectedNo account, no profile, no stored prompts or results.

What it can do

8 tools, grouped by job. Every one is read-only or compute-only.

OpenAPI
Read your data8 tools
  • List evalsList eval definitions (mock conversations that check an assistant's behavior) with name, description, type and timestamps.
  • List eval runsList eval runs with status, end reason, target, eval id, start and end time and cost in USD (conversation results are not returned).
  • List simulationsList simulations (a scenario paired with a tester personality) with name, scenario id, personality id and folder path.
  • List simulation scenariosList simulation scenarios (the script a tester follows) with name, instructions, folder path and timestamps.
  • List simulation personalitiesList tester personalities used in simulations (your own and Vapi defaults) with name, folder path and timestamps.
  • List simulation suitesList simulation suites with name, the simulation ids they contain, assigned assistants or squads and folder path.
  • List simulation runsList simulation runs with status, target, per-status item counts (passed, failed, running, queued), iterations and start and end time.
  • Get simulation concurrencyShow the organization's simulation concurrency limit, call slots in use and how many voice simulations can start now.

Information

PublisherUnify Dynamics LLC
CategoryDeveloper tools
LanguagesEnglish
Built forWorldwide
CompatibilityAny MCP client · any agent · REST
Version0.1.0
MCP endpointhttps://byok-vapi-testing.connectorbay.com/mcp
REST APIopenapi.json
SupportGet help · Status
CountryWorldwide
FunctionOther
LayerDeep connectors

More like this

More in Other

WaniKani (BYOK)

Read Japanese kanji and vocabulary reference data plus your own WaniKani level, lessons, reviews and study progress with your own API token

Live · MCP + REST9 tools

APIfootball (BYOK)

Read football (soccer) countries, leagues, teams, players, standings, fixtures, results and top scorers with your own APIfootball key

Live · MCP + REST9 tools

OpenTripMap (BYOK)

Look up tourist attractions, landmarks and points of interest near any place with your own OpenTripMap key

Live · MCP + REST5 tools

PractiTest (BYOK)

Read your PractiTest test management data (projects, requirements, tests, steps, test sets, instances, runs, milestones, issues and fields) with your own API token

Live · MCP + REST12 tools

Mintlify (BYOK)

Read your Mintlify documentation analytics (page views, visitors, searches, feedback, assistant usage) and deployment status with your own admin API key

Live · MCP + REST7 tools

OpsLevel (BYOK)

Read your OpsLevel software catalog services, teams, systems, domains, scorecards, deploys and infrastructure with your own API token

Live · MCP + REST12 tools

Get Vapi Testing (BYOK)

Free · BYOK · Read-only

BYOK: bring your own keyThis connector uses your own Vapi Testing private API key. Create one at https://dashboard.vapi.ai, with the fewest permissions it needs (read-only if the provider offers it). Your assistant sends it in the X-Upstream-Key header with every request. It is used for that one call only: never stored, logged or cached, and only ever sent to Vapi Testing. Revoke it at the provider whenever you like. Unofficial connector: not affiliated with Vapi Testing.