Ted Harris retweetledi

Proof that New Expensify's freelance contributor program is one of the largest and most sophisticated OSS projects in the world: OpenAI used 1488 of our real Upwork jobs to build the authoritative measure of AI coding capabilities. #freelance #OpenSource
x.com/OpenAI/status/…
OpenAI@OpenAI
Today we’re launching SWE-Lancer—a new, more realistic benchmark to evaluate the coding performance of AI models. SWE-Lancer includes over 1,400 freelance software engineering tasks from Upwork, valued at $1 million USD total in real-world payouts. openai.com/index/swe-lanc…
English













