Ali Jrl ☁️

793 posts

Ali Jrl ☁️ banner
Ali Jrl ☁️

Ali Jrl ☁️

@AliJrl

Technologist | Free thinker | On a continuous path of personal development

eu-south-1 Se unió Haziran 2019
2.3K Siguiendo159 Seguidores
Reads with Ravi
Reads with Ravi@readswithravi·
What’s one book a young person must read?
English
32
1
30
4.4K
Ambassador Jonathan Peled
Ambassador Jonathan Peled@JonathanPeled·
Condanniamo fermamente l’uso manipolatorio della recente copertina de L’Espresso. L'immagine distorce la complessa realtà con cui Israele deve convivere, promuovendo stereotipi e odio. Un giornalismo responsabile deve essere equilibrato e corretto. #MediaResponsibility
Italiano
5K
218
1.3K
2.9M
Velinus
Velinus@velinus_sage·
Been playing with Hermes like everyone else this week. Working on a skill that turns my X feed and bookmarks into @NotebookLM podcasts. My goal is to passively parse my feed to extract signal and get a podcast that keeps me current with the warp speed AI agent tooling progress. Hermes makes iterating easy. Big fan of what @NousResearch is doing. Repo in replies.
English
9
4
103
6K
Samuel Cardillo
Samuel Cardillo@CardilloSamuel·
the ceo of one of the companies i am helping to transfer into local inference via my dgx spark & hermes agent (see tweet x.com/CardilloSamuel…), an extremely big european corporate (and known), asked the assistant to create a picture of itself its running on my qwen3.5 37b a3b opus distill model and its not capable of image generation so it decided to answer wtih this 😂😂😂
Samuel Cardillo tweet media
Samuel Cardillo@CardilloSamuel

this little box has been serving qwen3.5 35b a3b with my own distillation to hermes agents via vllm to few companies basically, since my last tweet about how most consultants are absolute bozos who just install claude, overcharge and then disappear, i’ve got tons of traction so i took it upon myself - despite intense hours on crismon desert - to help out. i asked each companies that reached out to me: take a task you want an ai to accomplish for your company and define how private are the information it’ll need to handle. based on that, we take a decision and i help then understand why that is - so they get the thought process they can reapply for each of their use cases then, i deploy an hermes agent plugged to my spark so they can experience what a fully private personal assistant can do for them - and if they like it, they can buy their own spark and move the inference to it i have been doing this FOR FREE since the past 2 weeks, literally using my own time and electricity to spread the good word and fix the bullshit from all those failed ai experts that just pivoted in the industry out of nowhere.

English
9
2
29
4.3K
Ahmed Omar.
Ahmed Omar.@omar_or_ahmed·
@karpathy healthcare version: clinicians building patient knowledge bases. LLM compiles 200 EHR notes into patient wiki (dx, meds, labs, timeline). then query: "why is glucose up?" and it traces causality. same obsidian workflow but clinical data
English
3
0
8
1.5K
Andrej Karpathy
Andrej Karpathy@karpathy·
LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating knowledge (stored as markdown and images). The latest LLMs are quite good at it. So: Data ingest: I index source documents (articles, papers, repos, datasets, images, etc.) into a raw/ directory, then I use an LLM to incrementally "compile" a wiki, which is just a collection of .md files in a directory structure. The wiki includes summaries of all the data in raw/, backlinks, and then it categorizes data into concepts, writes articles for them, and links them all. To convert web articles into .md files I like to use the Obsidian Web Clipper extension, and then I also use a hotkey to download all the related images to local so that my LLM can easily reference them. IDE: I use Obsidian as the IDE "frontend" where I can view the raw data, the the compiled wiki, and the derived visualizations. Important to note that the LLM writes and maintains all of the data of the wiki, I rarely touch it directly. I've played with a few Obsidian plugins to render and view data in other ways (e.g. Marp for slides). Q&A: Where things get interesting is that once your wiki is big enough (e.g. mine on some recent research is ~100 articles and ~400K words), you can ask your LLM agent all kinds of complex questions against the wiki, and it will go off, research the answers, etc. I thought I had to reach for fancy RAG, but the LLM has been pretty good about auto-maintaining index files and brief summaries of all the documents and it reads all the important related data fairly easily at this ~small scale. Output: Instead of getting answers in text/terminal, I like to have it render markdown files for me, or slide shows (Marp format), or matplotlib images, all of which I then view again in Obsidian. You can imagine many other visual output formats depending on the query. Often, I end up "filing" the outputs back into the wiki to enhance it for further queries. So my own explorations and queries always "add up" in the knowledge base. Linting: I've run some LLM "health checks" over the wiki to e.g. find inconsistent data, impute missing data (with web searchers), find interesting connections for new article candidates, etc., to incrementally clean up the wiki and enhance its overall data integrity. The LLMs are quite good at suggesting further questions to ask and look into. Extra tools: I find myself developing additional tools to process the data, e.g. I vibe coded a small and naive search engine over the wiki, which I both use directly (in a web ui), but more often I want to hand it off to an LLM via CLI as a tool for larger queries. Further explorations: As the repo grows, the natural desire is to also think about synthetic data generation + finetuning to have your LLM "know" the data in its weights instead of just context windows. TLDR: raw data from a given number of sources is collected, then compiled by an LLM into a .md wiki, then operated on by various CLIs by the LLM to do Q&A and to incrementally enhance the wiki, and all of it viewable in Obsidian. You rarely ever write or edit the wiki manually, it's the domain of the LLM. I think there is room here for an incredible new product instead of a hacky collection of scripts.
English
2.7K
6.6K
55.5K
19.7M
Ali Jrl ☁️
Ali Jrl ☁️@AliJrl·
LLMs are commodities. It will be hard to create long term pricing strategies. Here’s what I think will make it harder: - rise in smaller specialised models that you’ll use for specific tasks. - spread of distilled model, created off of frontier closed models that you can run locally.
English
0
0
0
9
James Camp 🛠,🛠
James Camp 🛠,🛠@JamesonCamp·
This isn’t new. It wasn’t allowed anyway. We are 3 months out from local models doing everything that people use openclaw for anyway I have been using openrouter instead for Hermes But this brings up an interesting question… What is the monetization model for making money off of power users when local models get so good that you don’t need pay Anthropic or OpenAI anymore? Of course the average joe will always just pay $20 a month, but there may be a seismic shift coming
Boris Cherny@bcherny

Starting tomorrow at 12pm PT, Claude subscriptions will no longer cover usage on third-party tools like OpenClaw. You can still use these tools with your Claude login via extra usage bundles (now available at a discount), or with a Claude API key.

English
27
1
90
14K
James Camp 🛠,🛠
James Camp 🛠,🛠@JamesonCamp·
@AliJrl yes i saw that too! getting new macbook pro on saturday, considering keeping old one to run local if it can handle it
English
1
0
3
45
James Camp 🛠,🛠
James Camp 🛠,🛠@JamesonCamp·
$1500/mo for a remote SDR to do what Hermes is doing for me at $250/mo Set it up last night for Nano Flips newsletter ad sales It’s already > scraping competitors newsletters > finding advertisers >looking up right person on their team >reaching out >negotiating rates > and tracking everything in a CRM And I just chat with it through Telegram. Much less clunky than openclaw was. And it gets better on its own - learning which outreach gets opens, who actually buys, how to negotiate better Def not something I would pitch to an enterprise client or mid market firm yet. But for an SMB or freelancer…this is an amazing agent and kind of crazy
James Camp 🛠,🛠 tweet mediaJames Camp 🛠,🛠 tweet media
English
30
6
160
33.6K
Ali Jrl ☁️
Ali Jrl ☁️@AliJrl·
@JamesonCamp You should look into local models to reduce costs. I heard Gemma (a new model from Google) performs really well locally on regular machines. Also qwen. I’ll look further into that.
English
1
0
1
32
James Camp 🛠,🛠
James Camp 🛠,🛠@JamesonCamp·
@AliJrl it will RIP through tokens, so right now moslty sonnet, but will have it use opus for writing, and i think a lot i can get it to use haiku and will be fine instead
English
1
0
0
38
James Camp 🛠,🛠
James Camp 🛠,🛠@JamesonCamp·
i had some fantastic devs tell me openclaw was cool but not worth the time, and super unsure of the average person getting real value from it and then i just set up hermes in a few hours without calling our dev team. was texting them all night about how hyped i was i set it up haha
English
1
0
2
44
Ali Jrl ☁️
Ali Jrl ☁️@AliJrl·
@JamesonCamp Interesting - I’ll dive in this weekend. What model are you using? Are you using different models for different tasks?
English
1
0
1
21
James Camp 🛠,🛠
James Camp 🛠,🛠@JamesonCamp·
@AliJrl currently I am yes, and thats whats cool is with my edits it learns to get better for next time in the future i wont need to
English
1
0
2
174
Luke Metro
Luke Metro@luke_metro·
So does Anthropic buy Sourcery now or what
English
14
0
90
8K
Ali Jrl ☁️
Ali Jrl ☁️@AliJrl·
@SeeOn__ I was curious to ask you how you were rendering the floor plan on the left side.
English
1
0
1
24
Sudhir
Sudhir@SeeOn__·
Have been trying to figure out a way to load the entire plan from an image OpenCV+ OCR <- nope Gemini-3-flash-preview <- nope will be trying claude and gpt ... Let see how it goes
Sudhir@SeeOn__

its live on plan3D.in🚀 - 200+ Material - 3D model ( more soon...) - Your own Custom Material / Model - 2D Editor UI/UX improvement with scale - Set Overlay reference Scale - Support for Tablets - and much more... #threejs #buildinpublic #r3f

English
6
4
32
3K
Ali Jrl ☁️
Ali Jrl ☁️@AliJrl·
@sonofalli It was at this moment that everyone pivoted to EVO-as-a-Service.
English
0
0
0
70
Klaas
Klaas@forgebitz·
last year we had some massive billboards next to the highway/airport if you guess how many signups we got from it you get a free hat
Klaas tweet media
English
364
1
188
108.4K