Be the first to get access to new connectors. Get early access →
ConnectorBay Early access
Discover
LangSmith (BYOK) icon

LangSmith (BYOK)

Read your LangSmith tracing projects, runs, datasets, examples, feedback, annotation queues and prompt hub repositories with your own API key

Unify Dynamics LLC

Tools12read-only
Sign-inBYOKbring your own key
Key keptNeverused for one call only
PriceFreeoptional Pro limits
ProviderLangSmithunofficial, not affiliated
Works withMCP · RESTany agent

Try asking

Real questions, and the tools your agent calls to answer them.

Which LangSmith projects have the most runs?
Tools called
list_projects
Show the statistics of LangSmith project 3f1c2a9e-8b7d-4c1e-9a55-0d6f2b7a1c10
Tools called
get_project
What datasets do I have in LangSmith?
Tools called
list_datasets
How many examples are in LangSmith dataset 7a2e5d10-4b3c-4e8f-b1a9-6c0d9f3e2a11?
Tools called
get_dataset
Show some examples from LangSmith dataset 7a2e5d10-4b3c-4e8f-b1a9-6c0d9f3e2a11
Tools called
list_examples
Show the failed LLM runs of LangSmith project 3f1c2a9e-8b7d-4c1e-9a55-0d6f2b7a1c10 from the last day
Tools called
query_runs

About

LangSmith (BYOK) lets an AI assistant read your own LangSmith data through the LangSmith API with a key you supply (LangSmith API key (personal access token or service key)). Read-only: 12 tools (list_projects, get_project, list_datasets, get_dataset, list_examples, query_runs, get_run, list_feedback, list_annotation_queues, list_prompt_repos, list_workspaces, get_workspace_stats). The BYOK key travels with each request, is used for that one call only and is never stored, logged or cached; it is only ever sent to api.smith.langchain.com. Unofficial connector by Unify Dynamics LLC: not affiliated with, endorsed by or sponsored by LangSmith. LangSmith and its logos are trademarks of their owners and are used only to say which service the connector works with.

Sources: Live from the LangSmith API (api.smith.langchain.com) with a BYOK key; documentation: https://api.smith.langchain.com/openapi.json. Endpoints checked against that documentation on 2026-10-16.

Privacy

The publisher, Unify Dynamics LLC, states that tool inputs are processed in memory and not retained.

Data not collectedNo account, no profile, no stored prompts or results.

What it can do

12 tools, grouped by job. Every one is read-only or compute-only.

OpenAPI
Read your data12 tools
  • List projectsList tracing projects (sessions) in the workspace with start time, run count, error rate, latency percentiles, token totals and cost.
  • Get projectGet one tracing project with its start time, run count, error rate, latency, tokens and cost.
  • List datasetsList datasets with type, example count, number of experiments and modification time.
  • Get datasetGet one dataset's type, description, example count, experiment count and dates.
  • List examplesList examples of a dataset with inputs, outputs and metadata, most recent first.
  • Query runsQuery the runs (traces and spans) of one project, newest first, with status, type, timing, tokens, cost and error.
  • Get runGet one run (a trace or span) with name, type, status, timing, error, token counts, cost, tags and trace id.
  • List feedbackList feedback records (scores and comments) filtered by run, project or feedback key.
  • List annotation queuesList annotation queues with type, reviewer settings and size.
  • List prompt reposList prompt hub repositories with owner, tags, commit count, downloads and last update.
  • List workspacesList the workspaces (tenants) the key can access with name, role and whether it is personal.
  • Get workspace statsCount the current workspace's projects, datasets, prompt repositories, annotation queues, deployments, dashboards and evaluators.

Information

PublisherUnify Dynamics LLC
CategoryDeveloper tools
LanguagesEnglish
Built forWorldwide
CompatibilityAny MCP client · any agent · REST
Version0.1.0
MCP endpointhttps://byok-langsmith.connectorbay.com/mcp
REST APIopenapi.json
SupportGet help · Status
CountryWorldwide
FunctionOther
LayerDeep connectors

More like this

More in Other

Linear Config (BYOK)

Read Linear workspace settings, project and initiative labels, templates, integrations, customer tiers, release stages and SLA rules through its GraphQL API with your own personal API key

Live · MCP + REST10 tools

Shortcut Config (BYOK)

Read Shortcut custom fields, labels with usage counts, repositories, story templates, docs titles, workflow states and team settings with your own API token

Live · MCP + REST10 tools

Creatomate (BYOK)

Read your Creatomate video and image templates, render status and bulk-render feeds with your own project API key

Live · MCP + REST5 tools

Epos Now Floor Setup (BYOK)

Read your Epos Now location areas, table plans, devices, discount, refund and stock movement reasons and kitchen display settings with your own API credentials

Live · MCP + REST7 tools

Epos Now Menu Setup (BYOK)

Read your Epos Now brands, colours, tags, modifier groups, pop-up notes, recipes and measurement schemes with your own API credentials

Live · MCP + REST9 tools

Crossref Reference Lists (BYOK)

List Crossref work types and licenses and the works registered under a DOI prefix, member or work type with your own Metadata Plus token

Live · MCP + REST6 tools

Get LangSmith (BYOK)

Free · BYOK · Read-only

BYOK: bring your own keyThis connector uses your own LangSmith LangSmith API key (personal access token or service key). Create one at https://smith.langchain.com/settings, with the fewest permissions it needs (read-only if the provider offers it). Your assistant sends it in the X-Upstream-Key header with every request. It is used for that one call only: never stored, logged or cached, and only ever sent to LangSmith. Revoke it at the provider whenever you like. Unofficial connector: not affiliated with LangSmith.