2 weeks into testing local agent workflows and...
ngl Gemma4:31b and Qwen3.6:35b are cooking.
still not perfect, but it is a reasonable tradeoff if you consider cloud usage pricing.
it gets most of the work done, when it struggles with context - switch to cloud
ez wins
@austingriffith Speed is not an issue for as long as context of the model is within VRAM. When I ran 80+B models and context was being offloaded to RAM that's when it was getting really slow.
@austingriffith Austin, RAM is significantly slower than doing this on VRAM. I've been running local LLMs of various sizes in the past 2-3 months with 5090, and I can tell that 32b models are good at writing code if your prompts are more small task oriented instead of letting model figure it out
⚙️ Are the "local ai" guys basically just larping?
🐏 I have a machine with 128GB of RAM
🤖 I downloaded qwen3.5:122b
🤣 It takes 3 minutes to incorrectly do what sonnet 4.6 can do in seconds
😅 Am I doing it wrong? Do I need more RAM?
some thoughts as a noob on where we are:
we are fcked.
but no seriously, i have been a bigger bear than a hopeless bull. and this is not to say because of price action alone or people leaving crypto space.
the bigger reason is that even after more than a decade, we have not been able to find a pmf in crypto except for gambling and speculation. defi and payments remain the biggest moat of crypto, but nothing apart from that. decentralized social media is ded, infofi is ded, tokenizing everything/content coins are ded. there is no innovation happening.
another issue that adds fire is: just to reach from 120k from last cycle, we needed so so many things: a new president, etfs being passed, a new supportive regulatory board, DATs, new coins, new buzzwords.
now that we are below 69k and soon probably around 60k, we dont have a leverage to go back up exponentially. we dont have a new president, new etfs, new DATs etc. so what's next? very hard to lift up from here and i think we have entered a deep deep bear market and it will be like this for a while.
what we need from here on out: new ideas, more creativity, new innovative token designs as @EvgenyGaevoy
mentioned, new apps.
anyway, im still here and im inexperienced as compared to all the mfers. not sure what we'll do but i hope we get to good old days soon.
Waiting to see what exploits through #clawdbot will be possible. Idk why would anyone run somebody else's code and give it access to literally everything... I guess you all craved for this, but to me it seems like hackers wet dream
After observing the 1.5 Billion ByBit hack yesterday.
Myself and @sammyaudits decided to dive deeper into all the bug bounties on top 10 centralized exchanges.
What I've found is SHOCKING and Scary. Let's go through each one in the thread and callout the terrible and good security practices by different Cexes 🧵
Career Update:
After spending a solid 10 months scaling competitive audits and creating opportunities for the amazing @sherlockdefi Watsons, I've decided to move on to the next chapter.
I'm very excited to finally dive into the Ethereum ecosystem and explore the ZK world at @Scroll_ZKP.