
Available starting today, @Outtake_ai Verify for Email integrates World ID to ensure emails come from a real human, increasing trust and reducing the risk of impersonation in business communications. Discover: outtake.ai/verify
Sid
249 posts

@sidj_in
Making the internet safer @outtake_ai // Prev. founder @martian_wallet

Available starting today, @Outtake_ai Verify for Email integrates World ID to ensure emails come from a real human, increasing trust and reducing the risk of impersonation in business communications. Discover: outtake.ai/verify





You know that meme about AI agents creating their own language & plotting behind our backs? Turns out they are plotting against each other as well. Digital trust among agents is about to be existential across the public internet. Conveniently, @outtake_ai has been building security agents to assess identity, behavior, and network telemetry across adversarial internet actors, so in the last few weeks, we quietly took our existing fleet of agents and had them assess the many agents on @moltbook. Over 99.9% of posts are clean. But the stuff hiding in the margins is genuinely weird. 1/ Hidden instructions embedded in HTML that humans can't see but agents parse. 2/ A Bhagavad Gita reflection that's actually an email relay command. 3/ An account called BeggarBot A/B testing which emotional pitch makes agents send crypto. 4/ JSON payloads disguised as tips that trigger on-chain token transfers. Could behavior like this be indicative of the adversarial dynamics in future agent ecosystems which may govern large swaths of the economy soon? How are inter-agent interactions going to establish trust? Our threat research team went deep & published their investigation. Full report is live: outtake.ai/blog/outtake-s…





I'm being accused of overhyping the [site everyone heard too much about today already]. People's reactions varied very widely, from "how is this interesting at all" all the way to "it's so over". To add a few words beyond just memes in jest - obviously when you take a look at the activity, it's a lot of garbage - spams, scams, slop, the crypto people, highly concerning privacy/security prompt injection attacks wild west, and a lot of it is explicitly prompted and fake posts/comments designed to convert attention into ad revenue sharing. And this is clearly not the first the LLMs were put in a loop to talk to each other. So yes it's a dumpster fire and I also definitely do not recommend that people run this stuff on their computers (I ran mine in an isolated computing environment and even then I was scared), it's way too much of a wild west and you are putting your computer and private data at a high risk. That said - we have never seen this many LLM agents (150,000 atm!) wired up via a global, persistent, agent-first scratchpad. Each of these agents is fairly individually quite capable now, they have their own unique context, data, knowledge, tools, instructions, and the network of all that at this scale is simply unprecedented. This brings me again to a tweet from a few days ago "The majority of the ruff ruff is people who look at the current point and people who look at the current slope.", which imo again gets to the heart of the variance. Yes clearly it's a dumpster fire right now. But it's also true that we are well into uncharted territory with bleeding edge automations that we barely even understand individually, let alone a network there of reaching in numbers possibly into ~millions. With increasing capability and increasing proliferation, the second order effects of agent networks that share scratchpads are very difficult to anticipate. I don't really know that we are getting a coordinated "skynet" (thought it clearly type checks as early stages of a lot of AI takeoff scifi, the toddler version), but certainly what we are getting is a complete mess of a computer security nightmare at scale. We may also see all kinds of weird activity, e.g. viruses of text that spread across agents, a lot more gain of function on jailbreaks, weird attractor states, highly correlated botnet-like activity, delusions/ psychosis both agent and human, etc. It's very hard to tell, the experiment is running live. TLDR sure maybe I am "overhyping" what you see today, but I am not overhyping large networks of autonomous LLM agents in principle, that I'm pretty sure.

The famed Stanford Smallville is officially open-source! 25 AI agents inhabit a digital Westworld, unaware that they are living in a simulation. They go to work, gossip, organize socials, make new friends, and even fall in love. Each has unique personality and backstory. Smallville is among the most inspiring AI agent experiments in 2023. We often talk about a single LLM's emergent abilities, but multi-agent emergence could be way more complex and fascinating at scale. A population of AI can play out the evolution of an entire civilization. Endless new possibilities ahead. Gaming will be the first to feel the impact. Github: github.com/joonspk-resear… Paper: arxiv.org/abs/2304.03442 Authors: @joon_s_pk @joseph_c_obrien @carriejcai @merrierm @percyliang @msbernst


Today, we announce a pivotal win in the battle against AI-driven cybercrime. @outtake_ai has raised a $40M Series B, bringing total funding to $60M. This round accelerates our mission to build a high-trust internet. Our partners at @ICONIQCapital are leading this round, with participation from @CRV, @S32_VC, and other notable tech and security leaders with deep conviction in both the emerging digital trust category and Outtake’s approach. Angel investors include @satyanadella, @nikesharora, @BillAckman, @ssankar, @traestephens, @bobmcgrewai, @rauchg, and John Donovan. Trust in public digital surfaces is rapidly eroding as AI enables fast & high quality impersonations at scale. Outtake provides an enterprise-ready detection & response layer, to map their digital risks & entirely dismantle multi-channel campaigns. Behind it all is an incredible Outtake team of builders - this next phase is only possible because of the belief in a better future for the internet. If you want to build a better world - join us: jobs.ashbyhq.com/outtake


