Daniel Xu

envelope encryption is pretty cool

Every time opus updates it’s like getting a new coworker.

first pass at dlpack support in tinygrad: github.com/tinygrad/tinyg… this should unlock support for nccl4py. excited to play around with that later as well!

finished a fun end of year project: implementing FFT and LoRA in tinygrad: dxuuu.xyz/peft.html

Saw bpftrace as a qualification in a job description - how far it's come!

Found a nice bug in tinygrad’s llama 3 1b implementation: github.com/tinygrad/tinyg…

I used type erasure in python

The opposite of a cherry pick should be called an exorcism

Today Thinking Machines Lab is launching our research blog, Connectionism. Our first blog post is “Defeating Nondeterminism in LLM Inference” We believe that science is better when shared. Connectionism will cover topics as varied as our research is: from kernel numerics to prompt engineering. Here we share what we are working on and connect with the research community frequently and openly. The name Connectionism is a throwback to an earlier era of AI; it was the name of the subfield in the 1980s that studied neural networks and their similarity to biological brains. thinkingmachines.ai/blog/defeating…

At some point ruff is just gonna add a lint rule that converts your python into rust

One thought I’ve been coming back to is that code review skills are going to be increasingly more valuable as AI generates more and more code. Even in the span of a few months Claude code is incredibly more capable. I mostly just sit back and review code now.

TIL gentoo is a species of penguin. Which explains the Linux distribution

@majek04 bpftrace can also do some nifty error injection with override() builtin for allow listed kprobe sites. Syscalls are part of the included set. Not sure it gets much use out in the wild, though.

My fav little-known trick is to test various syscalls fail with strace fault injection, like: $ strace -e trace=clone -e fault=clone:error=EAGAIN news.ycombinator.com/item?id=440963…

Support for macros is landed in bpftrace! This addresses a long standing feature request - the ability to share arbitrary code between different probes. Go check it out!

Tried Claude code. Spent 9c to find out which repository I’m in. 🤔

Did some c++ template metaprogramming today. Weird Sunday.

@HaskRay What do you think the biggest gap is right now ?

llvm/llvm-project 6000. Should identify gaps, learn more things, and pay less attention on commits.

If you’re not embarrassed by your old code it’s a warning you’re stagnating

@javierhonduco Let’s meet up tomorrow!

🚆 to FOSDEM! Looking forward to it after missing last year’s!