Sam Stoelinga

Simple guide for anyone to deploy #Deepseek R1 14B on their laptop with a chat Web UI: @samos123/deploying-deepseek-r1-14b-on-my-laptop-using-kubernetes-and-ollama-f8340b3136b3" target="_blank" rel="nofollow noopener">medium.com/@samos123/depl…

github.com/substratusai/k… GitHub - substratusai/kubeai: AI Inference Operator for Kubernetes. The easiest way to serve ML mode

Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n

"AI Inference Operator for Kubernetes"

535 ⭐️ KubeAI is a Kubernetes-native platform for running AI/ML workloads. It simplifies the deployment 🔧 and management 📝 of AI models in Kubernetes clusters, making it easier to scale AI applications. #substratusai/kubeai&Date" target="_blank" rel="nofollow noopener">star-history.com/#substratusai/… #starhistory #GitHub #OpenSource

Tutorial: Deploying Llama 3.1 405B on #GKE Autopilot with 8 x A100 80GB substratus.ai/blog/deploying…

GitHub - substratusai/kubeai: Private Open AI on Kubernetes github.com/substratusai/k…

Tutorial: Private RAG with Verba, #Weaviate, Embedding Model and LLMs all running inside your own K8s cluster. Copy paste-able instructions for all. substratus.ai/blog/lingo-wea…

Need to provide a private OpenAI API compatible endpoint backed by OSS or fine-tuned LLMs? Lingo: an open source lightweight ML proxy and autoscaler for K8s makes this easy: github.com/substratusai/l…

Kind + GPU: A Local K8s cluster that can run GPU pods youtu.be/O1683vzaJVE?fe… via #k8s #nvidia #gpu #ml

Tutorial: Converting HuggingFace Models to GGML/GGUF format substratus.ai/blog/convertin…

producthunt.com/posts/substrat… Deploy and fine tune LLMs on K8s. Upvotes greatly appreciated!

@elonmusk Do they play xvideos at night? 🤣

Our headquarters tonight

@mehran__jalali minor correction, it's substratus.ai

@mehran__jalali substratus.io purpose is to make deploying and finetuning OSS LLMs just as easy as OpenAI. It's free and open source. Would love your feedback @mehran__jalali

Are there any platforms to fine-tune open source LLMs as easily as OpenAI lets you fine tune its base models?

Guide: Deploying #stablediffusion on #GKE autopilot samos-it.com/posts/deployin…

Unlock the power of Apache Kafka on #Kubernetes! Check out this tutorial to learn how to deploy and manage Kafka clusters with ease on #GKE for scalable and high-availability data streaming ↓ cloud.google.com/kubernetes-eng…

Annoyed about `gcloud container node-pools update --node-labels` overwriting all existing labels? Solve it with a simple bash script 😀 samos-it.com/posts/GKE-node…

⚡ Announcing the Spark Connector for Weaviate! 🗃️ The Spark Connector allows easy importing of data from @ApacheSpark into Weaviate 👀 Check out this tutorial to get started 👉 buff.ly/3jlleLp 👉 buff.ly/3YcAyc7 More in the 🧵