Anna Mitchell

2.3K posts

Anna Mitchell banner
Anna Mitchell

Anna Mitchell

@annarmitchell

@cognition balancing exit and voice 🗣

San Francisco Katılım Ağustos 2015
972 Takip Edilen3.6K Takipçiler
Anna Mitchell
Anna Mitchell@annarmitchell·
Loosely held hypothesis: there will be a surge of top talent back to Fortune 500 companies that have struggled over the last decade to compete for talent with startups, consulting, & finance. What we are seeing @cognition is that the companies who are adapting AI software engineering quickly are building completely different work cultures: each individual employee can ramp faster and have more impact, they are replacing legacy code with modern technologies, they're shifting to more, smaller teams with bigger goals. The work experience is massively better. And these are the companies that run most of the real world (e.g. financial services, aerospace, healthcare) - so the mission and impact are really compelling. I think this would be a really good thing for the world.
English
14
2
153
21.9K
Anna Mitchell
Anna Mitchell@annarmitchell·
@alt1na1 Around the world in 80 days (watching documentaries on the couch)
English
1
0
4
231
Anna Mitchell retweetledi
Cognition
Cognition@cognition·
Introducing SWE-1.7, the most capable model we’ve trained yet. It scores within a few points of the strongest frontier models at a fraction of the cost, and is now available at 1000 tok/s. RL is not hitting its limit: after refining our recipe, we keep seeing gains as we scale
Cognition tweet media
English
244
456
5K
1.6M
Anna Mitchell retweetledi
Nabeel S. Qureshi
Nabeel S. Qureshi@nabeelqu·
That's the spine. Fair hit. That's something to sit with. A real observation. That’s the whole thing. Sharpen that: say the word. Notice the arc of what just happened. One honest caveat: the full amount, stated plainly. Genuinely. Quietly. Honestly. That’s doing real work.
English
155
257
3.9K
554.6K
Vivek Gopalan
Vivek Gopalan@vvkgopalan·
I (Temu Dwarkesh) got to sit down with @madiator & @AlexGDimakis and talk about AI in CS education, RL scaling, how people will program capabilities into agents in the future, and interesting historical results from the first wave of reasoning models. Big day for @bespokelabsai
8VC@8vc

Much of the AI narrative revolves around architecture research, compute scaling & buying human data. Very few understand the deep technical discipline of "data research," which has driven many of the gains in model capabilities. @vvkgopalan sits down with @madiator & @AlexGDimakis, founders of @bespokelabsai, a company defining the category of data research. (00:00) Introducing Mahesh and Alex (03:40) Teaching a 1000 person ML class at Berkeley / changes in CS education in the age of AI (06:10) Open source data for frontier model training, OpenThoughts & training models for data curation (12:00) Why multiple-answer yields more performant models, benefits of keeping unverifiable examples in datasets (17:20) RL scaling laws / introduction to Bespoke (19:45) "Environment-driven Development" (28:35) New capabilities in frontier models & coding agents (34:30) Market outlook for RL environments (42:30) Exciting recent research and how we arrived at today's state of RL (50:00) Bespoke's Series A

English
3
1
49
4.2K
Anna Mitchell retweetledi
Jared Zoneraich
Jared Zoneraich@imjaredz·
Point #1 is why we felt Cognition just had to host a July 4th party We are not one of the big model labs, we are an independent company. And thus it's only fitting that we celebrate the independence of our country too! 🇺🇸 Thanks to all who came and celebrated with us in DC
Jared Zoneraich tweet mediaJared Zoneraich tweet mediaJared Zoneraich tweet media
Jared Zoneraich@imjaredz

Frankly I think this is the reason Devin is having such a comeback Nobody is really doubting the productivity gains of AI, and I would guess that companies would still be willing to pay the exponential if they must... But token spend is scaled and open source is now really good. It makes sense we are now spending energy to curb the runaway train Extreme high-growth startups are only now thinking about token spend, but this has been an enterprise (read: Publicly Traded Company) concern since day 1 Want to understand how Cognition so quickly grabbed all the big banks and giant Fortune 100 enterprises as customers? Aligned incentives is the answer. 1. Being an independent company Because we are not a model lab with $100B+ raised and $1T+ of data center commitments, we don't need to "catch up" by selling increasingly more expensive tokens Nor do we need to push a specific model family to make margins. Our only calculus is - "Is this the best model for the job?" - "Can we make the user more productive?" - "Can we save the user money?" (increasingly) This comes in the form of post-training research (building cheap + specifically tuned coding models) + new coding evals (FrontierCode benchmarks) + model routing (a lot behind-the-scenes of Devin's cloud harness). You should be skeptical of an Italian restaurant pushing the expensive market price specials. Just like you should be skeptical of a model lab pushing the newest most expensive model 2. Enterprise cost controls As a pre-requisite to selling enterprise contracts to the biggest companies in the world, you need really good spend controls. These banks and big conglomerates have been token-sensitive since day 1. They saw the writing on the exponential. For this reason, Devin has the most complete & robust spend controls of any coding agent on the market. The boring stuff of orgs, users, scopes, limits. But it matters. 3. AI Productivity alignment Cognition has an "AI Productivity Guarantee" That means if Devin delivers less engineering value than you’re paying for, Cognition will fund your usage until it does, up to $10 million. This is the tip of the iceberg and the one thing about Cognition that has been most novel to me since joining. Everything (and I mean everything) in our GTM motion is oriented around ROI. Every conversation is rooted in the actual engineering tickets we are taking off the backlog. I can only imagine what it would be like if instead conversations were rooted in "how can we entice users to burn through tokens"

English
17
5
88
14.2K
Max Martin
Max Martin@Max18Martin·
Y si sí???!!!
Max Martin tweet media
Español
2
0
12
1.1K
Anna Mitchell retweetledi
Scott Wu
Scott Wu@ScottWu46·
Happy 4th! Proud to be an American today and every day.
English
21
14
660
28.5K
Anna Mitchell
Anna Mitchell@annarmitchell·
It would be crazy to promote an employee based on how smart they are. Yet most companies using AI are paying for intelligence, not for results. Companies need to evaluate agents as they do human employees - based on impact.
English
1
2
37
2.2K
Anna Mitchell
Anna Mitchell@annarmitchell·
Security vulnerability remediation is a burning fire for enterprises. Teams are both drowning in findings from AI-generated code, and missing novel vulns enabled by AI. We launched Devin Security Swarm to find, validate, and remediate vulnerabilities. It's has higher recall than comparable tools and is 30% more cost-effective.
Cognition@cognition

Introducing Devin Security Swarm A more cost effective and accurate way to find security vulnerabilities in complex codebases, based on a new architecture: Agentic MapReduce.

English
3
0
18
1.3K
Anna Mitchell
Anna Mitchell@annarmitchell·
The concept of an "emergency contact" killed privacy forever. Why does my pilates studio need my mom's phone number?
English
2
0
3
623
Anna Mitchell
Anna Mitchell@annarmitchell·
There's a lot of hype around model routing, but most model routing doesn't hold up in the real world. We built a new multi-model harness for Devin that achieves 35% lower costs while maintaining frontier performance. We rolled it out internally, and almost everyone kept using it over the previous Devin harness!
Cognition@cognition

Conventional model routing sucks. It passes benchmarks but fails to write code you'd actually merge. Introducing Devin Fusion, a new hybrid-model harness for agentic coding. In testing, it reduces the cost of Fable-level intelligence by 35% and still feels good to use.

English
5
1
39
3.6K
aadilpickle
aadilpickle@aadilpickle·
ATTENTION WOMEN OF SAN FRANCISCO LOOKING FOR A HUSBAND: - my friend charles has just moved here to join athropic institute - hes a former Fed (men in power 😍) who worked for the DOE - went to berekley (gob ears🧸) for material science but dropped tech to make more impact in the public sector (he has principles!!) - very christian, very moral and good man, looking for someone with the same values (or willing to convert!) direct all inquires straight to @charlesxjyang 's DMs. Thank you for your attention to this urgent matter.
aadilpickle tweet mediaaadilpickle tweet media
English
35
11
335
133.4K
Anna Mitchell retweetledi
Theodor Marcu
Theodor Marcu@theodormarcu·
@annarmitchell Banger - I will only step out where it’s convenient for me, not for the waymo 🫡
English
0
1
4
466
Kyle Russell
Kyle Russell@kylebrussell·
@annarmitchell last week it yelled at us and made us get back inside and then shame-called support
English
1
0
1
231
Anna Mitchell
Anna Mitchell@annarmitchell·
Exiting the Waymo before its official drop off point feels so good
Anna Mitchell tweet media
English
8
1
41
3K