Be the first to get access to new connectors. Get early access →
ConnectorBay Early access
Discover
Scorecard (BYOK) icon

Scorecard (BYOK)

Read your Scorecard AI evaluation projects, testsets, metrics, metric groups, runs and systems with your own API key

Unify Dynamics LLC

Tools10read-only
Sign-inBYOKbring your own key
Key keptNeverused for one call only
PriceFreeoptional Pro limits
ProviderScorecardunofficial, not affiliated
Works withMCP · RESTany agent

Try asking

Real questions, and the tools your agent calls to answer them.

Which Scorecard projects do I have?
Tools called
list_projects
What testsets does my Scorecard project have?
Tools called
list_testsets
Show Scorecard testset ts_01
Tools called
get_testset
Which metrics does my Scorecard project use?
Tools called
list_metrics
Show Scorecard metric met_01
Tools called
get_metric
Which metric groups are defined in my Scorecard project?
Tools called
list_metric_groups

About

Scorecard (BYOK) lets an AI assistant read your own Scorecard data through the Scorecard API with a key you supply (Scorecard API key (starts with ak_)). Read-only: 10 tools (list_projects, list_testsets, get_testset, list_metrics, get_metric, list_metric_groups, list_runs, get_run, list_systems, get_system). The BYOK key travels with each request, is used for that one call only and is never stored, logged or cached; it is only ever sent to api2.scorecard.io. Unofficial connector by Unify Dynamics LLC: not affiliated with, endorsed by or sponsored by Scorecard. Scorecard and its logos are trademarks of their owners and are used only to say which service the connector works with.

Sources: Live from the Scorecard API (api2.scorecard.io) with a BYOK key; documentation: https://docs.scorecard.io/api-reference/overview. Endpoints checked against that documentation on 2026-10-16.

Privacy

The publisher, Unify Dynamics LLC, states that tool inputs are processed in memory and not retained.

Data not collectedNo account, no profile, no stored prompts or results.

What it can do

10 tools, grouped by job. Every one is read-only or compute-only.

OpenAPI
Read your data10 tools
  • List projectsList your Scorecard projects (oldest first) with id, name and description; paged by cursor.
  • List testsetsList a project's testsets with name, description and which fields map to inputs, expected answers and metadata.
  • Get testsetGet one testset's name, description and field mapping.
  • List metricsList a project's evaluation metrics with type, output type, judge model, passing threshold and guidelines; paged.
  • Get metricGet one metric's definition: evaluation type, guidelines, judge model and passing threshold.
  • List metric groupsList a project's metric groups (named sets of metrics) with their member metric ids.
  • List runsList a project's evaluation runs (newest first) with testset, system version, record and score counts and status.
  • Get runGet one run's testset, system version, metric ids, record and score counts and status.
  • List systemsList the systems (the AI products under test) of a project with production version and all version names.
  • Get systemGet one system with its production version and the list of versions.

Information

PublisherUnify Dynamics LLC
CategoryDeveloper tools
LanguagesEnglish
Built forWorldwide
CompatibilityAny MCP client · any agent · REST
Version0.1.0
MCP endpointhttps://byok-scorecard-ai.connectorbay.com/mcp
REST APIopenapi.json
SupportGet help · Status
CountryWorldwide
FunctionOther
LayerDeep connectors

More like this

More in Other

Celigo EU (BYOK)

Read your Celigo integrator.io (EU region) integrations, flows, run jobs, connections, scripts, tags and error counts with your own API token

Live · MCP + REST12 tools

Celigo US (BYOK)

Read your Celigo integrator.io (US region) integrations, flows, run jobs, connections, scripts, tags and error counts with your own API token

Live · MCP + REST12 tools

Dremio Cloud (BYOK)

Read your Dremio Cloud projects, engines, catalog objects, job status, reflections and saved scripts with your own personal access token

Live · MCP + REST9 tools

Astronomer (BYOK)

Read your Astro (managed Apache Airflow) organizations, workspaces, deployments, deploys, clusters, users and teams with your own API token

Live · MCP + REST10 tools

Datafold (BYOK)

Read your Datafold data sources, data diffs, monitors and monitor runs, CI runs and table lineage with your own API key

Live · MCP + REST11 tools

Holistics (BYOK)

Read your Holistics dashboards, data schedules, alerts, users, groups, data sources and job status with your own API key

Live · MCP + REST11 tools

Get Scorecard (BYOK)

Free · BYOK · Read-only

BYOK: bring your own keyThis connector uses your own Scorecard Scorecard API key (starts with ak_). Create one at https://app.scorecard.io/settings, with the fewest permissions it needs (read-only if the provider offers it). Your assistant sends it in the X-Upstream-Key header with every request. It is used for that one call only: never stored, logged or cached, and only ever sent to Scorecard. Revoke it at the provider whenever you like. Unofficial connector: not affiliated with Scorecard.