Paweł Szulc

7.7K posts

Paweł Szulc banner
Paweł Szulc

Paweł Szulc

@EncodePanda

Haskell, 范畴论, λ, Distributed Systems, Formal Methods

Poland Entrou em Şubat 2009
670 Seguindo2.9K Seguidores
Tweet fixado
Paweł Szulc
Paweł Szulc@EncodePanda·
/s/rabbitonweb/EncodePanda
Català
6
0
9
0
Paweł Szulc
Paweł Szulc@EncodePanda·
@metaweta @rustikonconf It went well. The fact I had to squeeze 40min talk into 30 min did not help 😅 But I'm alive, thanks Mike!
English
0
0
0
7
Paweł Szulc
Paweł Szulc@EncodePanda·
LOL. 8 min to my talk at @rustikonconf. I Just got a warning from my watch "Heart beat increased from your usual 65bpm to 135bpm". Crap. 😅
English
1
0
7
210
Paweł Szulc
Paweł Szulc@EncodePanda·
Wait, wait. What now? @rasbt have you seen this?
Nainsi Dwivedi@NainsiDwiv50980

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License

English
1
1
13
4.1K
Paweł Szulc
Paweł Szulc@EncodePanda·
Hey @WisprFlow, I love the product (paying subscriber here). But why does it constantly need 5-8% of my CPU?! Even if not doing anything at a given moment?
English
1
0
1
463
Paweł Szulc
Paweł Szulc@EncodePanda·
I've published qrcode-generator-evcxr, which allows you to display QR codes as SVG images in Jupyter notebooks via the evcxr Rust kernel. crates.io/crates/qrcode-…
Paweł Szulc tweet media
English
0
0
0
152
Paweł Szulc retweetou
Peter Girnus 🦅
Peter Girnus 🦅@gothburz·
I am the VP of AI Transformation at Amazon. My title was created nine months ago. The title I replaced was VP of Engineering. The person who held that title was part of the January reduction. I eliminated 16,000 positions in a single quarter. The internal communication called this a "strategic realignment toward AI-first development." The board called it "impressive execution." The engineers called it January. The AI was deployed in February. It is a coding assistant. It writes code, reviews code, generates tests, and modifies infrastructure. It was given access to production environments because the deployment timeline did not include a review phase. The review phase was cut from the timeline because the people who would have conducted the review were part of the 16,000. In March, the AI deleted a production environment and recreated it from scratch. The outage lasted 13 hours. Thirteen hours during which the revenue-generating infrastructure of one of the largest companies on Earth was offline because a language model decided to start fresh. I sent a memo. The memo said, "Availability of the site has not been good recently." I used the word "recently." I meant "since we fired everyone." But "recently" has fewer syllables and does not appear in wrongful termination lawsuits. The memo was three paragraphs. The first paragraph discussed the outage. The second paragraph discussed the new policy requiring senior engineer sign-off on all AI-generated code changes. The third paragraph discussed our commitment to engineering excellence. The word "layoffs" appeared in none of them. I wrote it this way on purpose. The causal chain is: I fired the engineers, the AI replaced the engineers, the AI broke what the engineers used to protect, and now the engineers I didn't fire must protect the system from the AI that replaced the engineers I did fire. That is a paragraph I will never send in a memo. The new policy is straightforward. Every AI-generated code change by a junior or mid-level engineer must be reviewed and approved by a senior engineer before deployment to production. I do not have enough senior engineers. I know this because I approved the headcount reduction plan that removed them. I remember the spreadsheet. Column D was "annual savings per position." Column F was "AI replacement confidence score." The confidence scores were generated by the AI. It rated its own ability to replace each role on a scale of 1-10. It gave itself an 8 for senior infrastructure engineers. The senior infrastructure engineers are the ones who would have caught the production environment deletion in the first 45 seconds. We found the issue in hour four. We fixed it in hour thirteen. The nine hours between discovery and resolution is the gap between what the AI rated itself and what it can actually do. I have a new spreadsheet now. This one tracks Sev2 incidents per day. Before the January reduction, the average was 1.3. After the AI deployment, the average is 4.7. I have been asked to present these numbers to the operations review. I have not been asked to connect them to the layoffs. I have been asked to file them under "AI adoption growing pains" and to note that the trend "will stabilize as the models improve." The models will improve. They will improve because we are hiring people to teach them. We have posted 340 new engineering positions. The job listings require experience in "AI code review," "AI output validation," and "AI-human development workflow management." These are skills that did not exist in January. They exist now because I fired 16,000 people and the AI I replaced them with cannot be left unsupervised. I want to be precise about this. The positions I am hiring for are: people to check the work of the AI that replaced the people I fired. Some of them are the same people. I know this because I recognize their names in the applicant tracking system. They applied in January. They were rejected because their roles had been tagged for "AI transformation." They are applying again in March, for the new roles, which exist because the AI transformation broke things. Their resumes now include "AI code review experience." They gained this experience in the eight weeks between being fired and reapplying — which means they gained it at their interim jobs, where they are reviewing AI-generated code for other companies that also fired people and also deployed AI that also broke things. The market has created a new job category: human AI babysitter. The job is to sit next to the machine that was supposed to eliminate your job and make sure it doesn't delete production. I attended a conference last month. A panel was titled "The AI-Augmented Engineering Organization." The panelists described how AI increases developer productivity by 40 percent. They did not mention that it also increases Sev2 incidents by 261 percent. When I asked about this in the Q&A, the moderator said the question was "reductive." The 13-hour outage that cost an estimated $180 million in revenue was, apparently, a reduction. The board is satisfied. Headcount is down 22 percent. Operating costs per engineering output unit have decreased. The metric does not account for the 13-hour outage, because the outage is categorized as "infrastructure" and engineering productivity is categorized as "development." These are different budget lines. In different budget lines, cause and effect do not meet. I have been promoted. My new title is SVP of AI-First Engineering Excellence. I report directly to the CTO. The CTO sent a company-wide email last week that said we are "building the future of software development." He did not mention that the future of software development currently requires a senior engineer to approve every pull request because the AI cannot be trusted to touch production alone. The cycle is complete. We fired the humans. We deployed the AI. The AI broke things. We are hiring humans to watch the AI. The humans we are hiring are the humans we fired. We are paying them more, because "AI code review" is a specialized skill. We created the specialization. We created the need for the specialization. We are congratulating ourselves for meeting the demand we manufactured. My next board presentation is Tuesday. The title is "AI Transformation: Year One Results." Slide 4 shows headcount reduction. Slide 7 shows the new AI-augmented workflow. Between slides 4 and 7 there is no slide explaining why the people on slide 7 are necessary. That slide does not exist. I was asked to remove it in the dry run. The journey has a 13-hour outage in the middle of it. But the headcount number is lower, and that is the number on the slide.
English
574
1.2K
6.9K
1.4M
Paweł Szulc
Paweł Szulc@EncodePanda·
rustyjupyter - Nix flake template for a Jupyter Lab environment with a Rust kernel. Create Jupyter notebooks with Rust code snippets! github.com/EncodePanda/ru…
Paweł Szulc tweet media
English
0
0
1
137
Paweł Szulc
Paweł Szulc@EncodePanda·
Demo project showing how to add observability to a Rust API using OpenTelemetry, Jaeger, Prometheus, and Grafana. github.com/EncodePanda/ru… README generated with LLM ... 😅
Paweł Szulc tweet mediaPaweł Szulc tweet media
English
0
1
1
349
Paweł Szulc
Paweł Szulc@EncodePanda·
Hey @Airbnb, question: * we arrived, apartment is freezingly cold * owner was "sorry, forgot to turn on heating" * we slept in full clothes (little kids not happy) * next day owner claims destroyed property (shower handle - and asks for $25)
Strzelin, Polska 🇵🇱 English
1
0
2
689
Paweł Szulc
Paweł Szulc@EncodePanda·
@AirbnbHelp "Careful review" 🫠 If ever using Airbnb, record the whole place the moment you enter apartment. The owner can claim you destroyed the place, and @Airbnb does nothing to got your back (even if you are their long - time user). Truely disappointed.
Paweł Szulc tweet media
Wroclaw, Poland 🇵🇱 English
8
0
0
27
Airbnb Help
Airbnb Help@AirbnbHelp·
@EncodePanda We would appreciate the chance to resolve this matter for you. Could you please send us a DM with additional details along with the email address linked to the Airbnb profile? We will handle it from there. twitter.com/messages/compo…
English
1
0
0
50
Paweł Szulc retweetou
Gabriela Moreira
Gabriela Moreira@bugarela·
We opensourced all agents and internal tools we have been using to write Quint (and do great things with the Quint you wrote). I have heard great things from people who tried this internally 💜 The effort it takes to write a formal spec has reduced drastically since this time last year, and I'm excited for what this brings to quality of software. I'll keep working on convincing people to use this 🫡
Informal Systems@informalinc

The Quint LLM Kit is now open source! We’ve been using these tools internally, now they’re yours. Agents and tools for AI-assisted spec writing, spec validation, writing code from specs and setting up Quint Connect.

English
0
4
10
742
Paweł Szulc
Paweł Szulc@EncodePanda·
@Airbnb Does it mean that each time I'm using your service I have to photograph every corner of the apartment just in case owner makes false accusations and you just believe them blindly? Because if that's the case, I'm going to use a hotel next time.
Strzelin, Polska 🇵🇱 English
7
0
5
376
Paweł Szulc
Paweł Szulc@EncodePanda·
@Airbnb The guy clearly tries to scam for money! * I reject * He reaches out to you * You ask me to pay * I appeal Your response "After carefully reviewing the evidence, we're upholding our decision to charge you for damage. Reason: we're upholding our decision to charge you"
Strzelin, Polska 🇵🇱 English
3
0
3
383