David L.
282 posts




Compilers are deterministic. Give them the same code with the same compiler settings, and you'll always receive the same binary. You can take responsibility for your software at the code level. LLMs, on the other hand, are stochastic. Even if you set the temperature to zero, you're likely to get different responses on the same prompt. Therefore, you need to understand the code it produces if you want to take ownership and responsibility for it.




@DavidL97085273 @MrTeaThyme @kerckhove_ts What do you mean even mean with "alloc returns a different address than the compiler"? Symbols get a unique ID. There's a pool of IDs that the compiler pops from. Depending on the order it pops things, symbols might get different IDs. Threading makes this order indeterministic.





























