merce’s cunning ham(ming it up)

Why does reverse-mode auto differentiation work OR what even is a derivative? A Christmas thread:

Cool well I'm an idiot and left my phone on a table in a little park in my neighb after eating lunch outside because it is nice out. I realized half a block away that I didn't have it and went back, but it was gone. I wiped it remotely and now it is in the Bronx.

One thing that recent advances have made clear is that we need to standardize how to talk about model sizes. I propose the following terminology for models with the given numbers of parameters < 1B: LLM < 1.5B: XLLM < 3B: BigGulpLM < 4B: DoubleGulpLM >= 5B: LMs of Unusual Size

Bill Orcutt guitar quartet at Roulette (sorry I missed it)

@atomly Imagine going to see Mandy (2018) at a drive-in in that

@travisbrown wow thanks!

@atomly basquiat me a brewski, bro!

@Quelklef @JadeMasterMath @analytichegel More explicitly about "newtyping it": you could make a dataclass that wraps the thing you want and define operations on that e.g. make your own integer type for which addition is max. I'm sure there's a way to get the methods onto the classes, but I don't know Python.

@JadeMasterMath @analytichegel actually this makes me wonder if one could have semi-automatic deriving with a class decorator and some runtime introspection

really bleak stuff

Cool, back to harassing my mortgage lender on Twitter to get them to provide basic services that they claim to provide.

@AskCitizensBank the Tax Documents section when I log in is empty, but I should have a 1098. I tried calling but there is no option to speak to a representative and your online help chat is currently unavailable. It is March 20th. Please let me know how I can get my tax doc asap.

this phenomenon is called token smuggling, we are splitting our adversarial prompt into tokens that GPT-4 doesn't piece together before starting its output this allows us to get past its content filters every time if you split the adversarial prompt correctly

- Oh, you engineer prompts for state-of-the-art chatbots that internet people try to dunk on Chomsky with? Cool! - No, I just show up on time.

guy at the (palo alto) library (in quiet room) has just been saying "oh fuck" and "oh no" and "jesus" every few minutes for the last hour

I was going to make a joke about how I come here for the choice content, then my partner walked in and we had a minutes long conversation about the dog's poop

The Banach in Baby Spinach really leapt out at me today

@thebasepoint @NYCMayor 95% in 32 years is in improvement over phase 1 of 4 of the second avenue subway in 45 years so things are looking up! en.wikipedia.org/wiki/Second_Av…

@mioalter @NYCMayor 95% accessible by...2055?!

.@NYCMayor when exactly is this more accessible future? I take my toddler on the subway—e.g. today to the museum of natural history—and it is the rare exception that I do not have carry all 30+ pounds of her in her stroller up and down multiple flights of stairs.

I want David Cronenberg to design the new USB standard, so all the ports and plugs sigh and moan and writhe before finally accommodating each other’s anatomy in a blissful, disturbing union that allows charging and data transfer to occur effortlessly between all equipment.

@atomly yikes