CJ Wright

~50% of AI “safety” benchmarks highly correlate with compute across models. We added “compute correlations” to our recent safetywashing paper, showing that compute is a driving force behind a lot of “safety” benchmark advances: arxiv.org/abs/2407.21792

Sam Altman shared that OpenAI is losing money on its o1 pro model ($200/month) because of usage, but... because of how reasoning models work, $200/month is likely inherently too low of a price point. Based on known stats about reasoning models, it should cost ~$1000/month to break even. Here's why. Open-source reasoning models show that the "reasoning" part of the model produces about 10,000 hidden, intermediary "reasoning" tokens (chain of thought, etc.) per 1,000 outputted tokens. In other words, for every 1,000 tokens you see outputted by the model, it's actually generated 11,000 (with 10,000 under the hood). That alone should put the price point for a reasoning model like o1 pro at 11x the standard price ($20) - $220. But then we need to consider the cost of the expanded context length. Typically, models can handle multiple requests (multiple users) at once. However, as the context length of a request gets longer, the amount of concurrent requests the model can handle is reduced - it's estimated that reasoning models reduce the number of possible concurrent users by 75-80%. In other words, only 1/4 - 1/5 as many people can use the model at the same time. Therefore, you need to multiple that cost by 4-5x. Now we're at $880-1100/month.

@CigarCitySec rumor has it there’s a local Discord… any chance you’d DM an invite?

Breaking: The Federal Reserve cut rates by a half point, choosing the more-aggressive option for its first cut in four years on.wsj.com/3XQMPVh on.wsj.com/3XQMPVh

@ONCD Thanks @jakerella 🍻

@ONCD Finally submitted my PR for plank-holders 🎉 Can someone review & approve? Thanks for the fun challenge!

Thanks to everyone who took part in the ONCD #badge #challenge. We are out of physical badges but we will always need more plankholders! #DefCon

@jaysonstreet @defcon Thank you so much for my first DEFCON mementos 🍻 Had no idea how special Goon coins are & the 3d printed Jack ring’s fantastic. Safe travels home!

This @defcon has been an amazing, awesome & wonderful blur which is the main reason there’s a delay in posting and that trend continues I’ll be posting the Sunday memories today! I’m waking up way too early now finishing my breakfast & will be teaching #defcontraining soon! 😁

@akredhat @ONCD @jakerella Congrats 🎉 I waited til 10:30p to start the challenge & just realized they ran out of badges while I was @ dinner 🤦‍♂️😆 Well earned

@ONCD Honored to be the first to complete the challenge! Well done @ONCD @jakerella!

Trying to get your hands on this year’s @ONCD #badge? Find us on GitHub to become an Open Source Software Security Plankholder! #challenge

we got an ~RCE on M365 Copilot by sending an email by ~RCE I mean full remote control over its actions - search for sensitive content (sharepoint, email, calendar, teams), execute plugins and outputs - bypass DLP controls, manipulate references, social engineer its users on our behalf #BHUSA #DEFCON @tamirishaysh

Barath Raghavan and Bruce Schneier argue that the CrowdStrike outage “is yet another reminder of how brittle global internet infrastructure is. It’s complex, deeply interconnected, and filled with single points of failure.” lawfaremedia.org/article/the-cr…

First day at Crowdstrike, pushed a little update and taking the afternoon off ✌️

@TheRoaringKitty 🪐Unobtanium Hands 🙌🏻

This guy wins at LinkedIn.

Google AI overview suggests adding glue to get cheese to stick to pizza, and it turns out the source is an 11 year old Reddit comment from user F*cksmith 😂

@NiteingGail Left (so open & airy)

Right, of course. Always Wright.

What happens when Gabby or Rachael wanna send home a guy that’s vibing with the other #Bachelorette ? #BachelorNation #TheBachelorette

The vibe in tech has definitely changed in the past few months. Nearly everyone I know is keeping a pulse on the job market with plans to exit their current company within 6-12 months. A quick 🧵 on why this is happening, and what managers should consider doing about it.

What’s a startup conspiracy theory you believe? Mine: OKRs were actually a psyop from Google to slow down potential early stage competitors

@HowtoADHD Hamburger, rice, & gravy. 1 cup rice & 2 cups water in rice cooker. While rice cooks, brown 1 lb ground beef. Drain. Mix 1 package brown gravy w/1 cup water. Bring to boil & immediately pour/mix into drained browned beef. Rice should be done now. Season & serve to taste.

Hello Brains! Many of us have go-to meals that are easy/quick enough even for busy weeks and bad brain days. What's your favorite "low executive function" meal to make? (I'm not looking for gourmet, just "counts as food") I may attempt to make it / include in a video :)