Pavlos Ratis

@dadideo the sample website is down, but you could clone the repo and run it locally or in a remote server.

@dastergon Is it not working anymore?

Happy to announce the first stable release of Wheel of Misfortune. It's a role-playing game for incident management training via simulated outage scenarios. Spin the wheel and enjoy the debugging journey. dastergon.gr/wheel-of-misfo… #SiteReliabilityEngineering

@rakyll Congrats, Jaana!

My new old self.

Apple announces LLM in a flash: Efficient Large Language Model Inference with Limited Memory paper page: huggingface.co/papers/2312.11… Large language models (LLMs) are central to modern natural language processing, delivering exceptional performance in various tasks. However, their intensive computational and memory requirements present challenges, especially for devices with limited DRAM capacity. This paper tackles the challenge of efficiently running LLMs that exceed the available DRAM capacity by storing the model parameters on flash memory but bringing them on demand to DRAM. Our method involves constructing an inference cost model that harmonizes with the flash memory behavior, guiding us to optimize in two critical areas: reducing the volume of data transferred from flash and reading data in larger, more contiguous chunks. Within this flash memory-informed framework, we introduce two principal techniques. First, "windowing'" strategically reduces data transfer by reusing previously activated neurons, and second, "row-column bundling", tailored to the sequential data access strengths of flash memory, increases the size of data chunks read from flash memory. These methods collectively enable running models up to twice the size of the available DRAM, with a 4-5x and 20-25x increase in inference speed compared to naive loading approaches in CPU and GPU, respectively. Our integration of sparsity awareness, context-adaptive loading, and a hardware-oriented design paves the way for effective inference of LLMs on devices with limited memory.

If you're SRE or SRE-adjacent, it would be great to spend some time filling out catchpoint.com/sre-survey -- one of the few ways we can get cross-company readings on what's happening with the profession. Thank you for your time in advance!

Watching my first #WWDC23 as an Apple employee! Great job to all the teams!

Are you an SRE looking to make a difference in your org? Use research, data, and math to slay MTTR. Find it in the 2022 VOID Report: thevoid.community/report

Would be curious to hear from practising SREs whether or not this captures their experiences

If you are responsible for production infrastructure this is for you: thevoid.community/report

I feel it is a great curated resource for SREs Great work @dastergon 👏 twitter.com/dastergon/stat…

Awesome Site Reliability Engineering by @dastergon github.com/dastergon/awes… #devops #devsecops #kubernetes #cicd #k8s #linux #docker #sysadmin #automation #Azure #infrastructureascode #cloudcomputing #serverless #terraform #ansible #yaml #sre

The SRE Book did a lot of things. Were enough of them good? @lauralifts has takes! stanza.systems/post/should-we…

Just in case you’re looking, my org at Apple is hiring SREs, engineering managers, infrastructure managers, a system’s reliability tech lead, a cloud SRE manager, build engineers and much more. These aren’t full time remote roles, but im happy to provide more info in dms

I'm a big believer that great products are a result of healthy autonomy. It means less interdependencies between teams, strong API/data boundaries, mature capacity planning, the devops model where devs are operators of their services.

I’m happy to share that I’m starting a new position as Site Reliability Engineer at @Apple!

@rakyll So sorry for your loss 🙏

I lost my father in law almost a week ago 😢 I’m glad that I have an incredibly supportive leadership and coworkers at GitHub. Everyone was so kind and helpful, and kept asking me to focus on my family. These flowers really meant a lot for me.

@micahlerner @urlichsanais . @dastergon gave a talk at #SREcon21 on the "Lessons Learned Using the Operator Pattern to Build a Kubernetes Platform," usenix.org/conference/sre… youtube.com/watch?v=F-MLsA…

@Sh1bumi All the best, Christian!

A few days ago I made the most difficult decision of my career and resigned at Red Hat. Red Hat has been a wonderful employer and workplace for me. I never worked at a place with so much respect, kindness and fun. My team became like a family. I will miss you folks. ❤️❤️❤️

Oh look, redhat.com/sre is live! 🎉 @RedHat @OperateFirst

usenix.org/publications/l… USENIX's login magazine very kindly agreed to publish a slightly elaborated, text version of my keynote from last year's SRECon EMEA. Thanks to @lauralifts, @NYCDubliner and @systemician amongst many others for review + support.