Adam Louly

1.9K posts

Adam Louly banner
Adam Louly

Adam Louly

@LoulyAdam

Inference Engineering @Microsoft

Bellevue, WA Katılım Nisan 2017
441 Takip Edilen780 Takipçiler
hippiesoul🏜️
hippiesoul🏜️@Ghitz01·
Saraha PhD dial 3 ans makhssh ikoun m3tarf bih
Indonesia
27
5
72
9.9K
Arbaoui Mehdi 🔬
Arbaoui Mehdi 🔬@arbaoui_mehdi·
ماشي نفس الأورڭازم ديال تكتب كود راسك ولا تخلي كلود يكتبو ليك. يقدرو يوصلك لنفس النتيجة، ولكن معمرهم يوصلك لنفس الإحساس.
العربية
7
0
36
2.1K
Adam Louly
Adam Louly@LoulyAdam·
@isbkch Don’t have a number yet, probably 0 if we’re talking about money
English
0
0
0
47
Elias
Elias@isbkch·
@LoulyAdam Depends... What's the ROI on this?
English
1
0
1
366
Adam Louly
Adam Louly@LoulyAdam·
AI bill for this week ... this is getting out of hand.
Adam Louly tweet media
English
2
0
2
666
Adam Louly
Adam Louly@LoulyAdam·
@alilakrakbi Inconvenient even f states, takes 40 mins for fast charge to 80%. Maybe have two: one electric and one gas that you can use if you’re short in time
English
0
0
2
161
Adam Louly
Adam Louly@LoulyAdam·
@isbkch M4 Max 36GB is doing bad too! Thinking of getting the 128GB one 👀
English
1
0
2
140
Elias
Elias@isbkch·
I have never thought the M4 Pro 24 Go of RAM will do me this bad Looking at you Superset AI
Elias tweet mediaElias tweet media
English
5
0
13
2K
Daniel Han
Daniel Han@danielhanchen·
If you find Claude Code with local models to be 90% slower, it's because CC prepends some attribution headers, and this changes per message causing it to invalidate the entire prompt cache / KV cache. So generation becomes O(N^2) not O(N) for LLMs.
Unsloth AI@UnslothAI

Note: Claude Code invalidates the KV cache for local models by prepending some IDs, making inference 90% slower. See how to fix it here: #fixing-90-slower-inference-in-claude-code" target="_blank" rel="nofollow noopener">unsloth.ai/docs/basics/cl…

English
41
135
1.6K
174.7K
Adam Louly
Adam Louly@LoulyAdam·
How do you entertain yourself while waiting for your codex-5.4-X-Mega-High-Thinking to finish its task?
English
0
0
3
270
Adil Mania.
Adil Mania.@adilmania·
february was absolutely mogged.
English
181
274
2.9K
385.8K
Adam Louly
Adam Louly@LoulyAdam·
@soub4i I don't think kprintf exists in cuda, I've never used it before. apparently the printf fix was a false positive and ended up being a totally different issue.
English
0
0
1
21
Abderrahim
Abderrahim@soub4i·
@LoulyAdam What happened to the kprintf() 👀 .. but for answer your question: No!
English
1
0
1
58
Adam Louly
Adam Louly@LoulyAdam·
Is it ever legal to leave a printf in a cuda kernel if it resolves a heisenbug?
English
1
0
2
216
Adam Louly
Adam Louly@LoulyAdam·
@MIduoad I think he got a point, how would you cluster ga3 dok ideas and come up with top k ideas?
English
0
0
2
102
Adam Louly
Adam Louly@LoulyAdam·
Is there a way to have one agent act as an orchestrator so you only talk to that agent, and it then manages the other 4-5 agents, gives you status updates on each, and dispatches tasks to them?
English
1
0
2
213
Adam Louly
Adam Louly@LoulyAdam·
That’s not accurate. The $500k investment from YC wouldn’t attract a group of ex-FAANG, that’s probably less than their TC.. Unless it’s for the network, I believe YC invests more in ambitious young founders, which is what I appreciate about them. Unlike A12Z, Sequoia, those firms would invest in experienced founders from major tech companies.
English
1
0
1
113
Yezz123
Yezz123@yezz123·
@LoulyAdam @ycombinator @llmgateway Yeah, it seems so. The investment in retarded people working and coming from big corporations is a way to synchronize their money flow without adding any value to the market 😅
English
2
0
2
176
Yezz123
Yezz123@yezz123·
I’m genuinely curious to understand how @ycombinator selects startups for investment. - Real users? @llmgateway already has a significant number of real users who pay real money to use their service. - Good revenue? If trustmrr.com/startup/llm-ga… isn’t sufficient, you can contact @smakosh, and he will share a screen with you to view @stripe’s revenue. - Well-educated founders? Their testimonials already demonstrate their genuine behavior and characteristics. - Project potential? It’s either the current or perhaps the only startup in the market that faces openrouter (or we can call them closedrouter 😭) competition.
Smakosh@smakosh

We just got rejected from @ycombinator Here's what we built without them: → ~$600K ARR (see link in the replies) → Profitable since month 6 → 210+ paying customers → 887 GitHub stars → 200+ AI models, 25+ providers, one API → 2 co-founders, both part-time YC would've been great. But we're not waiting for permission to keep building. Onward 🫡

English
5
0
19
3.5K