Artificial Intelligence

Braintrust, worked by an AI employee

Not another app for your team to learn, and not a set of rules for you to build. You hire an AI employee, you give it access to your Braintrust account, and you ask it for things in Slack or Teams the way you would ask anyone else on the team. There is nothing to map and nothing to maintain.

  • Artificial Intelligence
  • Connects with a key
  • 17 ready-made tools
  • Asked in Slack or Teams
At work

An illustration of how the conversation reads, not a transcript from a client account.

What Braintrust is

Braintrust is an AI engineering platform for managing prompts, datasets, experiments, evaluations, observability, and production AI applications.

You paste in a key from your own Braintrust account. It is kept encrypted, and you can withdraw it from inside Braintrust whenever you like.

How a run works

One message in, the work done in Braintrust.

  1. 01

    You ask

    You message your AI employee in the chat your team already has open, in one sentence, in your own words.

  2. 02

    It works out the step

    It decides what the job needs in Braintrust. You do not pick anything from a menu or wire anything together.

  3. 03

    It does the work

    Signed in to your own Braintrust account, inside the access you granted it, doing the thing you asked for.

  4. 04

    It reports back

    It tells you what it did, in the same thread. If it could not do something, it says so rather than guessing.

17 tools it already has

What it can do in Braintrust

These are the ready-made tools your AI employee already has in Braintrust. It is not limited to them, but it never has to be taught these.

  • Create DatasetCreate a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
  • Create ExperimentCreate an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensurenew is true, which creates an exper
  • Create ProjectCreate a Braintrust project, or return the existing project unchanged when its name already exists.
  • Create PromptUpsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the sto
  • Delete Experiment, Dataset, or PromptDelete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
  • Delete ProjectSoft-delete a Braintrust project and return its deletion state.
  • Fetch EventsFetch one newest-to-oldest page of project log, experiment, or dataset events.
  • Get Braintrust ResourceGet one project, experiment, dataset, prompt, or function by UUID.
  • Insert Dataset EventsUpsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
  • Insert Experiment EventsUpsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
  • List Braintrust ResourcesList and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
  • Query Braintrust DataRun one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later page
  • Summarize Experiment or DatasetReturn metadata and optional aggregate summaries for one Braintrust experiment or dataset.
  • Update DatasetUpdate the name, description, tags, or metadata of a Braintrust dataset. At least one non-null mutable field is required.
  • Update ExperimentUpdate selected metadata and linkage fields on a Braintrust experiment. At least one non-null mutable field is required.
  • Update ProjectUpdate selected fields of a Braintrust project. At least one non-null mutable field is required: name, description, or settings.
  • Update PromptUpdate a Braintrust prompt's metadata or configuration without invoking it. At least one non-null mutable field is required.
Access, and who is in charge of it

You stay the boss of your Braintrust account.

Nothing connects until you approve it. You grant access one app at a time, you can take it back the same way, and everything your AI employee does in there is written down where you can see it.

How we handle your data
  • It signs in to your own Braintrust account. You are not moving anything into ours.
  • You grant access one app at a time, and you can take it back the same way.
  • Everything it does in Braintrust is written down, with what it did and when.
  • Anything you tell it to check with you first, it checks with you first.
Other apps in the same corner of the business

It works in Braintrust and the rest of your software in the same job

A real job rarely stays in one place. Reading a message in one app, checking a record in another and writing the result in a third is one request to your AI employee, not three.

Questions people ask about Braintrust

Can an AI employee really work inside Braintrust?
Yes. It signs in to your own Braintrust account and works in it the way a new hire would, from the chat your team already has open. Nobody installs anything, and nobody learns a new screen.
Do I have to move anything out of Braintrust?
No. Nothing moves and nothing is replaced. Your records stay in Braintrust, your team carries on in the same screens they used yesterday, and your AI employee works alongside them in there.
How does it get into my Braintrust account?
You paste in a key from your own Braintrust account. It is kept encrypted, and you can withdraw it from inside Braintrust whenever you like. You approve it before anything connects, and you can take the access back the same way you gave it.
What can it actually do in Braintrust?
It has 17 ready-made tools in Braintrust today, among them Create Dataset, Create Experiment and Create Project. The full list is on this page. It is not limited to those, but it never has to be taught them.
Can it use Braintrust and the rest of my software in the same job?
Yes, and that is usually the point. Reading a message in one app, checking a record in Braintrust and writing the result somewhere else is one request to your AI employee, not three separate ones you stitch together.
Who decides what it is allowed to do in Braintrust?
You do. You grant access one app at a time and can withdraw it at any time, anything you ask it to check with you first it checks with you first, and everything it does in Braintrust is written down with what it did and when.