Cloudy Softwares
19 posts

Cloudy Softwares
@cloudysoftwares
Compute infrastructure for training AI models at scale.






cursor's tab completion blog post accurately describes the infrastructure i’m building at cloudy:



atm, i’m working on adding multinode, reserved instances & a one click benchmark product for llm, image & video models. you will be able to spin off a training job and run benchmarks on your checkpoints seamlessly & in parallel, with no additional setup or uploads to huggingface.


i'm working on an open-source repo that teaches people llm inference optimisations. rn the fastest files on the repo are at 6.5-7k tps, as compared to vllm's 10k for the same batch size. i added a c++ implementation today. feel free to try it out (wip): github.com/naklecha/llm-i…

Hello, World!







