gkotsis retweetledi
Launch day 🎉 meet Anton - an LLM judge specifically trained for evaluating search systems. Available as an API, it enables you to evaluate any search index at near-human quality in 1/10th the time & cost.
Anton is the first in a suite of AI agents we’re building that are specifically trained for enabling great search experiences. For website and app developers, delivering relevant search results is crucial to driving business success. We’ve seen over and over that relevance is correlated with online business metrics like engagement, conversion rates, and revenue.
Evaluating search relevance at scale, however, is challenging and time-consuming. The process typically involves engineers or search quality raters spending hours reviewing hundreds or thousands of results. Or, for the busiest teams, it means a quick spot check “looks good to me” that very often leaves serious gaps in search quality.
Anton makes this process easy by automating the task of rating results. We've evaluated it across multiple data types and found that agreement with humans is high. This means you can trust Anton to work alongside you, speeding up your iterations and enabling you to make more data driven decisions.
Our customers have already been leveraging Anton for months through some of our most used features like auto-fine tuning and evaluations. Today we're excited to open it up to everyone as a simple to use API. We can't wait to see what you'll build!
Live demo link below
English
