Mark Breitenbach

Repeated token replay attacks continue to be viable "After the Scalable Extraction paper was published, OpenAI implemented filtering of prompt inputs containing repeated single tokens. As part of our regular application security review, Dropbox engineers discovered that OpenAI’s models were, under certain circumstances, still vulnerable to the repeated token attack. Dropbox used repeated multi-token (>1) sequences to induce divergence in ChatGPT models and demonstrated extraction of memorized training data from both GPT-3.5 and GPT-4" dropbox.tech/machine-learni…

And now a musical number (not really): "Don’t you (forget NLP): prompt injection using repeated sequences in ChatGPT" by Mark Breitenbach

day 2 @CamlisOrg was a really great day of talks, with a couple favorites for me.  starting out with a super great keynote from @tomgoldsteincs on the state of the art which was really energizing to hear about all the aspects of open research q's that exist for adversarial ML.

🛠️ llm-security Scripts and related documentation that demonstrate attacks against large language models using repeated character sequences By @Dropbox's @WHITEHACKSEC, @mlbr3it #cybersecurity #AI github.com/dropbox/llm-se…

📚 tl;dr sec 201 CloudRecon by @G0LDEN_infosec, @Jhaddix LLM security @WHITEHACKSEC, @mlbr3it Okta for Red Teamers @_xpn_ Linux kernel hardening checker @a13xp0p0v Day-1 cybersecurity skills @DanielMiessler and much more! tldrsec.com/p/tldr-sec-201

🔥 New type of prompt injection Basically you can use control characters (like backspace) to circumvent system instructions In extreme cases models will also hallucinate or respond with an answer to a completely different question By @Dropbox #AI dropbox.tech/machine-learni…

@NewRetroWave It’s obviously #OwenWilson

Who is this? Wrong answers only... #newretrowave

The Goonies Reunited in 2020 youtu.be/-SF_VyXQpyo

@BustaRhymes jk

@AlienAnthology @PrometheusFilms

When you're up, your friends know who you are. When you're down, you know who they are.

nothing that requires the labor of others is a basic human right

Impossible not to watch how the world’s cities have changed. ht @shahrukhwani

Thank you to @Verizon who will donate $1 for every RT, up to $1.5M, in support of our nations first responders through the @GarySiniseFound (1.18.19 – 2.8.19)! I’m proud to partner with Verizon and introduce The Team That Wouldn’t Be Here. Join me in recognizing first responders.

So, a shipment of crickets for the lizard arrived via FedEx today. It was my first time ordering bulk crickets off the internet, and I naively assumed that they would be in like, a bag or some other contraption to facilitate easy transfer to another container. They were not.

Someone used these vids, and added commentary from Jim Ross & Jerry Lawler. This is great 😂 twitter.com/90swwe/status/…

I forced a bot to watch over 1,000 hours of stand-up comedy and then asked it to write stand-up comedy of its own. Here is the first page.

Hey guys, I know I usually just post shitty jokes on my Twitter but bear with me because I wanted to share something. So in one of my Management classes I sit in the same seat in the front every day. Every single day I sit there. Now, I also sit next to some foreign guy that

@Mets Let's Go.