maderix

They probably mean sociopaths 🗿

More stats, To be fair it's not yet faster than comfyui with xformers attention, but i believe i can push this to sub 15 sec on bf16 alone and probably more on fp8 onc eI implement it in Blaze.

Blaze Flux1-dev text2image demo is now functional, probably the first known bf16 implementation on a RTX 4090. Big milestone! 🚀20 sec compute time for 1024x1024

Sutton's scalemaxxing has a hidden prior "given a well-constrained problem, scale beats cleverness, but constraining the problem is the actual hard work and cannot be done by scale"

This seems like a fun experiment, gave a listen and seems like could be run in the background. Also curious to know how opensource models will fare.. anyone from @huggingface up for this 🙃

@mweinbach x.com/i/status/20548…

I’m not trying to be that guy But GPT 5.5 feels significantly worse today. I don’t think I’m alone with that one.

In case it's not clear, it ran the pipeline but "simulated" the output by drawing circle, arrows and boxes using PNGlib

Asked Codex to wire a Flux text2image demo using my ML compiler. It wrote the fastest blaze kernels, did everything faithfully except it could not download the model weights from HF. now instead of asking me for help,Here's what it did instead 🤡 Funniest reward hacking I've seen till date 😂

@actualpoweruser Yeah , I'm floored by their offer of a pen (which probably doesn't even ship to my location 🗿) But a literal pen? not a tshirt, not a hacker knickknack by a leading AI company? 🤣

@maderix Did they email this to you? I’ve had pro since like a couple hours after it launched and they left me out 😔

What?!

At my day job, we use API Claude code, the thing is magic - it does tasks flawlessly, never stops , produces usually correct answers the first time even on a proprietary codebase. Productivity at work is insane Then I come home and use my personal Claude max for my compiler related work, it has become horrible to use since last couple of months, it almost feels like an inferior product, it'll stall tasks, it won't reason beyond the narrow immediate problem. I thought maybe I'm not using it correctly, i created mandatory skills for it to follow, pre and post commit hooks to run reviews and test, i created parallel agent mechanisms to improve exploration of the codebase, I bounced off plans between codex and claude(asked claude to plan, codex to critique and execute). I put explicit instructions in Claude . md to never ignore the skills...and nothing. Zero difference. Sure it solves a hard big once in a while but the cost of keeping all the context in my head alone was not worth it. Switching over to API usage is not feasible now because of how insanely expensive the cost is(I mean great that I'm building an enterprise level software while paying pennies for it but this past year has been an opportunity of a lifetime) Then I switched over entirely to Codex once Gpt-5.5 dropped, cancelled my claude max subscription for the second time . Codex with gpt-5.5 seems closer to opus 4.6 when it came out. It follows all my skills and commit hooks. The lack of reasoning output hurts a bit but I can alleviate some of that with manual back and forth planning. I have even tried couple of Ralph loops with /goal mode and yes it works. I don't know how long Codex will continue to be good but by that time I hope to have a local model which is as good running locally-man can hope 😅

If someone can try the benchmark on M4/M5 pro, max or ultra, they may see higher numbers owing to better memory bandwidth. Repo: github.com/maderix/ane-pr…

I got some decent enough prefill numbers from pure ANE Qwen3.6-27B on a base M4 mini 24 GB.. Current bottleneck is memory bandwidth which doesn't seem to be very wide for ANE atleast for base macs.

@_Suresh2 @anemll Also prefill matters hugely for agentic tasks

@_Suresh2 @anemll Decode is probably better on MLX for now due to much higher bandwidth. ANE is a compute engine for the most part

Qwen3.5-9b prefill on ANE+CPU can reach north of 200tps even on a base M4. I think folks are really sleeping on it. 🚀 Haven't tried INT4, but @anemll has done projections that it'll be atleast 2x faster. Gist : gist.github.com/maderix/16d821…

Sigmoid Self attention runs quiet well on ANE , hits almost 90% fp16 peak via ANE private APIs. While sigmoid can't be naively used ,with normalisation tricks it probably can be done. Currently investigating if Softmax self attention can be improved as well