Braintrust

550 posts

Braintrust banner
Braintrust

Braintrust

@braintrust

The observability layer for production AI.

Katılım Ağustos 2023
54 Takip Edilen6.2K Takipçiler
Sabitlenmiş Tweet
Braintrust
Braintrust@braintrust·
Braintrust has raised an $80M Series B. We're building the infrastructure that helps teams measure, evaluate, and improve their AI products. Don't take our word for it. Hear how @NotionHQ, @Vercel, @Navan, and @billcom use Braintrust to ship quality AI.
English
27
22
271
123.2K
Braintrust
Braintrust@braintrust·
Braintrust Gateway now shows detailed model information for every supported provider. Compare capabilities, context windows, and API types across OpenAI, Anthropic, Google, AWS, and open-source models in one place.
English
1
0
1
198
Braintrust
Braintrust@braintrust·
One dataset ≠ one eval. It's possible to run multiple evals on the same dataset to test different measures of AI quality, like factuality, personality, and effectiveness in resolving customer complaints.
English
0
1
3
188
Braintrust
Braintrust@braintrust·
The best AI product managers know whether or not their product is improving. DevRel engineer @darubberduckiee is hosting an Evals 101 workshop built for PMs. Learn how to measure the performance and quality of AI products.
Braintrust tweet media
English
3
1
5
266
Braintrust
Braintrust@braintrust·
Starter is a new Braintrust pricing plan with no platform fee. It includes: - 1GB processed data - 10K scores - 14 day retention You can pay for more usage as your AI workloads grow.
Braintrust tweet media
English
1
2
13
5.5K
Braintrust
Braintrust@braintrust·
What's new: - Playground bulk optimization: annotate multiple outputs across prompts and let Loop optimize prompts for you - Improved trace and span search: faster, and scoped to the current span or the trace - TypeScript auto-instrumentation: auto-trace all TS LLM calls
English
1
2
5
808
Braintrust
Braintrust@braintrust·
For providers subject to the GDPR, the architecture of a platform matters as much as the feature set it offers. Braintrust's platform was intentionally built to separate the control plane from the data plane, making compliance with GDPR feasible.
Braintrust tweet media
English
1
0
2
331
Braintrust
Braintrust@braintrust·
Trace everything
Braintrust tweet mediaBraintrust tweet mediaBraintrust tweet media
English
0
0
8
294
Braintrust
Braintrust@braintrust·
What's new in Braintrust: Observability and evals work best when built directly into developer workflows. DevRel engineer @daRubberDuckiee demos Gateway, Topics, and trace-level scoring. Learn how teams surface insights across thousands of interactions to improve AI quality.
Braintrust tweet media
English
2
1
5
375
Braintrust
Braintrust@braintrust·
At @Dropbox, evals are the new PRD. Evaluation scorers are defined before product development begins. Then production traces feed back into new datasets, inform prompt optimizations, and guide fine-tuning decisions, creating a quality feedback loop.
English
1
0
7
574
Braintrust
Braintrust@braintrust·
Trace fireside chat: Agent observability at scale. @Replit built and scaled AI observability to support rapid iteration without sacrificing reliability.
Braintrust tweet media
English
2
0
9
3.4K