Mini mal

707 posts

Mini mal

Mini mal

@gatelevelanon

posting into the void. semiconductor things. VLSI / RTL / comp arch / operating systems / automotive / aerospace

가입일 Şubat 2025
115 팔로잉91 팔로워
고정된 트윗
Mini mal
Mini mal@gatelevelanon·
$INTC can increase as much SRAM density. Groq can build inference chips with $NVDA. But can they force undo the enshittification of the software stack ? How far can hardware efficiency go to cover for the the inefficiencies of the software bloat?
English
1
0
3
5.5K
Mini mal
Mini mal@gatelevelanon·
@alexocheema You are comparing a garage built go kart with a le mans Ferrari. Not a fair comparison
English
1
0
8
968
Alex Cheema
Alex Cheema@alexocheema·
My M4 Max MacBook gets 3,756,165 tok/sec in pure C, compared to ~50,000 tok/sec with the FPGA. Try it yourself: github.com/AlexCheema/tal…
luthira@luthiraabeykoon

We implemented @karpathy 's MicroGPT fully on FPGA fabric. No GPU. No PyTorch. No CPU inference loop. Just a transformer burned into hardware, generating 50,000+ tokens/sec. The model is small, but the idea is not: inference does not have to live only in software 👇

English
45
55
987
121.8K
Mini mal
Mini mal@gatelevelanon·
Have you wondered that they don't spend enough time on verification and testing as they used to? They have transitioned from a 3 product per year company to dozens per year, many of them custom builds for large clients. I have seen this happen many times in the semiconductor industry. Shorter design-to-product end up in all design stages getting compressed, including verification and testing.
English
0
0
2
98
HealthRanger
HealthRanger@HealthRanger·
I used to love Nvidia... that is, until I started to use more of their high-end, more expensive products. The more I bought them and tried to use them, the more I saw Nvidia shipped buggy, faulty products that simply don't live up to the hype (or even the claimed specifications). And when I tried to have a $9000+ GPU replaced under warranty, well within the claimed warranty period, Nvidia refused. They stopped responding and took zero responsibility for their faulty product. Then I checked the pricing for their newest "Spark Station" products (based on the GB 300 chipset) shipping now. One systems integrator quoted me $180,000 for a single system. And I knew there would be virtually zero driver support and no warranty support either, based on my previous experience. So I said no. I used to be a fan of Jensen Huang (he's from Taiwan, where I lived for a few years), but now I increasingly see him as a sales hypester pushing product fantasies that don't ship on time, that don't perform to spec, and that simply aren't worth the money. It all seems like vaporware gaslighting to pump up Nvidia's stock price now. AMD's Strix Halo platform, I found, runs LLM inference models (even very large ones) at very close to the same speed as NVIDIA hardware, but for typically less than half the price. And they use a lot less power, too. Apple Mac hardware has much faster unified RAM and is becoming increasingly popular for AI projects, with long wait times due to the surge in orders from customers. Meanwhile, Nvidia keeps promising revolutionary chipsets that never ship on time and that utterly lack driver support or warranty support when they do actually ship. Just a couple of months ago, they DOUBLED the prices of their 5090 cards, raising them from around $2500 to $5000 with no real justification that made any sense. They were just PRICE GOUGING their customers because they could get away with it. If you want a $5,000 brick on your desk, buy an Nvidia DGX Spark. And hope it doesn't set your desk on fire, because it has horrifically bad thermal management and has been known to literally melt many materials. The AMD Strix Halo platform (I own some mini-PC boxes running it) run cool and quiet, with a fraction of the energy usage. Like I said, I used to be a fan of Nvidia. But something changed with them. It seems they abandoned quality control. They became obsessed with higher stock prices instead of higher quality products. They abandoned their customers and price gouged them wherever they could. Using Nvidia products feels like you're fighting against a corporation that hates you. That's why I'm done with Nvidia. My company typically spends several hundred thousand dollars a year on hardware, and I run a mini data center with 48 workstations and a few proper rackmount servers, serving millions of users with high-quality AI content creation, AI-enhanced research engines, infographic image generation and more. From now on, I'm ditching Nvidia and looking elsewhere. Intel, AMD, Apple, TensTorrent... I'll take my AI business to a company that actually cares about its quality, its warranties and its customers.
English
14
13
126
4.6K
Mini mal
Mini mal@gatelevelanon·
Does anyone know of a lighter alternative of APB to access control and status registers on a low speed peripheral ? APB is very light, but I need something even lighter.
English
0
0
0
16
Mini mal
Mini mal@gatelevelanon·
@yacineMTB An AGI that predicts the next ragebait token from this account.
English
1
0
0
36
Mini mal
Mini mal@gatelevelanon·
@yacineMTB At this point someone should make a yacine ragebait tracker
English
1
0
6
1.6K
kache
kache@yacineMTB·
Everything should be statically linked. Dynamic linking is idiotic
English
141
15
661
151.1K
Mini mal
Mini mal@gatelevelanon·
@KyleMorgenstein You put three emojis in your title card. You don't get to preach huh
English
0
0
0
237
Mini mal
Mini mal@gatelevelanon·
@1a1n1d1y It ain't paying my bills it is a time worthy occupation while my agents fire up those tokens.
English
0
0
1
12
andy
andy@1a1n1d1y·
you wanna run a whole god damn tech startup? be funny on twitter
English
30
5
195
6K
Mini mal
Mini mal@gatelevelanon·
@weswinder The "perception of value" is different from "value" itself. Your perception is a small weight. The market value will be the weighted sum of all perceived values.
English
0
0
0
273
Mini mal
Mini mal@gatelevelanon·
There is an incentive to add slop wherever possible, whichever market allows it. > It happened to food (processed sugar replaced real fruits, palm oil replaced natural fats). > It happened to cars (premium leather replaced by cheap substitutes, rubber quality became poor, solid metal parts replaced with cheap plastic) > happened to fuel You think they won't do it to mere AI tokens? What is so shocking about this
English
0
0
0
202
Mini mal
Mini mal@gatelevelanon·
@splinedrive MMU doing the heavy lifting. Nice. Have you measured a slowdown factor (how many real world seconds it takes to run a CPU second) ?
English
0
0
1
59
Mini mal
Mini mal@gatelevelanon·
@yacineMTB Not dissing on the founders. But on the system that makes everything boring.
English
0
0
1
75
Mini mal
Mini mal@gatelevelanon·
Funded startups follow scripts and playbooks because they are funded by culturally similar sources. This guy got his Series B. The agency allocated a marketing consultancy budget. The consultant had a script and a schedule and a camera. He just acted it out. Most startups are pretending to be different while being all the same. Look at everything they do.
English
1
0
13
2K
kache
kache@yacineMTB·
I cannot stand this uninspired bullshit ad shooting style. You are a startup founder. Take out a phone and record yourself talking like a normal human being. You are literally just a person. You are ctrl cing the "personal" directing why don't you actually be personal??
Warp@warpdotdev

Warp is now open-source.

English
67
16
609
81.8K
kache
kache@yacineMTB·
Man. For some reason codex started performing really poorly on programming my goblin roguelite indie game
English
48
7
922
33.7K
Adam Richard Turner
Adam Richard Turner@devadam88·
London based developers, reveal yourselves! 🇬🇧
Adam Richard Turner tweet media
English
64
1
111
7.4K
Mini mal
Mini mal@gatelevelanon·
@nilscmr Sent in less than 24 hours. Few minutes remaining.
English
0
0
0
11
Nils Cremer
Nils Cremer@nilscmr·
CPUs suck. We're building a new general-purpose chip that scales to thousands of cores while being more energy-efficient. We're hiring hardware design engineers, consider joining us tendrils.co/jobs What we do differently ...
English
58
48
460
100.3K