Nathan retweetledi
Nathan
5 posts

Nathan retweetledi
Nathan retweetledi

I started a part-time role at @ETH_AI_Center, mentoring students and working on post-training for the Swiss AI Initiative!
🤩Looking forward to working with interesting people like @a_yukh @ImanolSchlag @Noah_Xu_ @nathanrchn @ArnoutDevos
If you are a student at ETHZ or EPFL looking for a semester or thesis project on post-training of LLMs, please reach out!
English
Nathan retweetledi
Nathan retweetledi

I have a few qualms with the OpenAI API:
For a Linux user, you can already build such a system yourself quite trivially by buying a 4xH100 box, installing it at home, installing CUDA and vLLM locally, and running GLM, Kimi, or a comparable open-source model. With typical consumer workloads, you should expect higher TPS for a fraction of the cost.

English




