Caleb Peffer (Hiring!)
1.5K posts
@CalebPeffer
Co-founder and CEO @firecrawl ️🔥 Prompting humans and machines. Be the best version of yourself.
I think the impact of this document has not yet been understood. This is not some silly mumbling about "application scenarios". Jie Tang is a Tsinghua professor, one of the patriarchs of Chinese AI, leader of the GLM project. He says: yes, I know what AGI means. It must be open.
Can we actually get @garrytan to comment on this? If this turns out not to be true (high probability), congrats - you destroyed your entire credibility for a bit of social media attention If it ends up being true, @ycombinator has deep internal problems to address Just saying...
Introducing Firecrawl Research Index, a specialized index for agents pushing the frontier of AI/ML research. State-of-the-art recall on arXivQA, beating the next best provider by 18% at similar cost. Now powering autonomous R&D at @Aemon_ai, a record-breaking YC research lab.
Introducing Prometheus, an experimental Forward Deployed Agent for web data. Describe the web data you need and it writes Firecrawl code to collect it. Run it yourself or let us host and automatically maintain it as pages change. Try it with Claude Fable 5 for free this week!
Welp, that happened faster than I predicted. Thought it would be end of 2027, then early 2027, but agentic traffic growing so fast that bots have now passed human traffic online for the first time in the Internet's history. #bot-vs-human" target="_blank" rel="nofollow noopener">radar.cloudflare.com/traffic#bot-vs…
We've now fetched 8,000,000,000+ pages at Firecrawl 🔥 A few other milestones in 2 short years: - 1.25M+ developers - 150K+ companies using us - 125K+ GitHub stars (top 100 repo) - 2.5M+ weekly downloads on npm + PyPI. Thanks for building with us & we're just getting started!
Hot take on what comes next, after the sudden decline of tokenmaxxing: - OpenAI will struggle - with the decline of tokenmaxxing Anthropic will struggle (aside from this quarter) to make a profit - Google will catch up to Anthropic - some Chinese companies might, too - LLMs will become commodities; margins will be very very thin - Most of the companies that invested massively in them will struggle to make back their investments - SpaceX’s AI efforts will flail - Nvidia will eventually decline, once all of the above becomes widely recognized.
The web wasn't built for AI agents. So we built Firecrawl. - /search finds fresh, relevant sources from the web - /scrape turns any URL into clean context for AI - /interact automates clicks, pagination, and logins Join 1,000,000+ developers connecting intelligence to the web.
The Context Acquisition Company (CAC). We are a holding company acquiring services firms for their tokens in order to build domain specific agents/ models to deploy into our platform businesses and beyond. There's $1T hidden in the computers. We're gonna get it out.
@CalebPeffer Survivorship bias. For every unicorn, dozens of VC-backed startups burned billions extracting from LPs. I build for sustainable margins, not Series D valuations.
