Caleb Peffer (Hiring!)

Excited to announce @firecrawl's $14.5M Series A 🔥 We've grown 15x in the past 12 months. The demand for clean web data in AI is real. Here's the story of how we built the web data layer for AI - starting from a side project to powering how 350k+ builders get web data 🧵

Java is goat!

Introducing the new Firecrawl CLI 🔥 The toolkit for agents to scrape, search, and browse the web. - Scrape clean data from any page - Search the web and get full results back - Spin up cloud browsers for interactive flows npx -y firecrawl-cli@latest init --all --browser

@firecrawl LFG

The internet is full of valuable data - but most of it is buried in massive archives. With our browser, you can turn those archives into your own custom knowledge base in seconds. Like this dataset of vintage software from 1990–1998 👇

Firecrawl has been nominated for Web App of the Year! Lots of fun and countless hours went into building our app experience, on top of the amazing landing work by @oguzyagizkara and @necatikcl Thanks @mobbin

I am biased, but we made it super easy for you to add web scraping, search and browse capabilities to your agents. Literally 1 command away. > npx -y firecrawl-cli@latest init --all --browser

Lately my research workflow got 10x better by using Claude agent teams and basically treating the filesystem + firecrawl as a web data toolkit: → (1) search + scrape for fast mapping + relevant content → (2) real browser environments when pages need interaction or need sessions to be persisted (clicks, pagination, auth) → (3) parallel agents write their findings back into the repo (notes, citation, etc) You get faster + more accurate results, and everything lands locally so any agent can resume where it left off

@yasser_elsaid_ Great post

Pendulum swings in the narrative are at an all time high rn. 6 months ago the narrative was OpenAI is impossible to compete with. But now whenever Anthropic drops something new they wipe a few hundred billion off the public market overnight. OpenAI doesn't get the same reaction. Every time the narrative shifts, the same people shift with it. The problem with the popular opinion is that it sounds smart, that's how it became popular. You can't win by following the herd. The herd is either wrong, or it's right but it's already a herd then it's too late, the opportunity is gone. Opportunity comes when you know something others don't. Form your own opinions. And if that's a contrarian opinion and you're right, you win.

Good taste. High signal.

Firecrawl now extracts PDFs faster and more accurately with our new Rust-based parser. - 3x faster - Cleaner data for RAG + AI search - Three modes: Fast, Auto, OCR Perfect for builders who need to extract data from academic papers, regulatory filings, and more.

/scrape returns clean markdown by default. But that's only one of 8 output formats. Typed JSON, screenshots, raw HTML, links - you can pull any combination in a single request 🔥

our next project: browser sandbox a secure browser environment for agents to interact with the web → zero config → loaded with agent-browser + playwright → agents can safely exec bash, py, js to control the browser → works with any agent like claude code, openclaw, codex

Do not let LLMs write skills for you. At best, they do nothing. Models can’t author domain expertise that actually moves the needle arxiv.org/pdf/2602.12670

@dcodeblock25 🫡 - I'll let our board know

@CalebPeffer I am not doing this with your browser agent, f that, will try this with my coding and typing skills until I solve 10/10 Then, I can apply for the role of CEO :)

We’re hiring cracked agent orchestrators 10 problems. 45 seconds. Solve them all and we'll make it worth your while :) cheetcode-ctf.firecrawl.dev 🔥

@Isiphon1 fixed!

@th3nolo Yeah. Back up now 😅

@CalebPeffer Crazy the amount of traffic the cft got

@jameshalldon @brianbellx New high score. Almost double the last. Hard cap, you say?

@brianbellx @CalebPeffer yea at this point we hit a mostly hard cap, the team was removing entries earlier today and trying to tighten security on it. not worth exploring atm until we get a final update to compete again otherwise we're just burning tokens 😅

@huntclubhero I'm the ceo and I built it myself. I'll talk to the board immediately 🫡

@CalebPeffer bruh maybe fire the guy that built the game first....200/10 is nuts

@mdev_1 Teehee - you will get bonus points. Opus is patching the exploit and updating scores as we speak :)

@CalebPeffer why is it over 9000😭

@CalebPeffer oh... x.com/jameshalldon/s…

@jameshalldon Max score is 2900 ;)

@CalebPeffer x.com/jameshalldon/s…