Kyle Widmann

What sets this apart: fully open-source (rebuild the image yourself, self-host attestation if you want). No black boxes. Attestation + LUKS gating + no SSH + runtime enforcement (OPA policies, signed images/charts, per-job keys released after GPU attestation) minimizes trust in providers/miners. Live TEE models at chutes.ai (Qwen/Mistral variants in enclaves). 🚀 #DecentralizedAI #OpenSource

Core pieces: • github.com/chutesai/sek8s → standalone TEE setup: builds encrypted images, attestation services, GPU drivers; disk decrypts only after TDX measurement verification (RTMRs) during boot—if attestation fails, VM doesn't start properly. • github.com/chutesai/chute… → refactored for federated clusters, TEE integration via TDX and Nvidia GPU attestation. Miners provide verifiable private inference with no direct guest access.

Been building secure, decentralized inference infra for Chutes AI. Open-sourced TEE VM stack: Intel TDX VMs with hardened k3s clusters, full NVIDIA GPU passthrough, remote attestation, LUKS-encrypted disks, and zero SSH access. Goal: verifiable confidential compute where miners/hosts can't peek—even in a permissionless network. Thread 👇 #ConfidentialComputing #TEE