David Nintang

335 posts

David Nintang banner
David Nintang

David Nintang

@davidnintang

Student & Builder

Somewhere over the rainbow Katılım Ocak 2022
892 Takip Edilen246 Takipçiler
Blaze
Blaze@browomo·
This Chinese developer launched Llama 70B locally on a MacBook on a plane and for a full 11 hours without internet ran client projects. He was sitting by the window on a transatlantic flight with a MacBook Pro M4 with 64 GB of memory. WiFi on board cost $25 for the flight. He declined. No cloud API, no connection to Anthropic or OpenAI servers, no internet at all. Just a local Llama 3.3 70B on bf16 and his own orchestrator script. The model runs through llama.cpp. Generation speed, 71 tokens per second. Context around 60,000 tokens. Memory usage, 48.6 GiB out of 64. Battery at takeoff, 3 hours 21 minutes. And he gave the orchestrator this system prompt before takeoff: "You are an offline orchestrator running on a single MacBook. There is no network. The only resources you have are local files in /Users/dev/work, the Llama 70B inference server at localhost:8080, and a battery budget of 3 hours 21 minutes. Process the queue at /Users/dev/work/queue.jsonl (one client task per line). For each task: draft → run local evals → save artefact to /Users/dev/work/done/. Save context checkpoints every 12 tasks so you can resume after a battery swap. Stop only on empty queue or when battery drops below 5%." So the system knows exactly what resources it is running on. It knows it has no connection to the outside world for the next 11 hours. It knows it has finite memory and a finite battery. It knows the human will not intervene until the plane lands. The system runs in 1 loop. Takes a task from the queue, runs it through inference, saves the artifact, writes a checkpoint. Task after task, just like that. And only when the battery drops below 5% does the orchestrator automatically pause, waits for the laptop to switch to the backup power bank, and continues from the last checkpoint. Here is what the system actually writes in his log during the flight: "saved context checkpoint 8 of 12 (pos_min = 488, pos_max = 50118, size = 62.813 MiB)" "restored context checkpoint (pos_min = 488, pos_max = 50118)" "prompt processing progress: n_tokens = 50 / 60 818" "task 37016 done | tps = 71 s tokens text → /Users/dev/work/done/proposal_westside.md" Outside the window, clouds, blue sky, and no WiFi. On the tray, 1 MacBook, an open terminal on 2 screens, and an inference server on localhost. From what I have observed, this is the cleanest offline AI workflow I have seen in the past year: 11 hours of flight, $0 for WiFi, and the entire client queue closed before landing.
Khairallah AL-Awady@eng_khairallah1

x.com/i/article/2049…

English
126
300
3.1K
1.8M
OpenAI Developers
OpenAI Developers@OpenAIDevs·
You can build interactive applications with gpt-realtime-1.5, so users can control app state more naturally with voice. Hi Chappy 👋
English
218
553
6.9K
1.8M
David Nintang
David Nintang@davidnintang·
Servers for blockchain???
English
0
0
0
42
David Nintang retweetledi
Founders Inc
Founders Inc@fdotinc·
see you tmr :)
Founders Inc tweet media
English
60
37
391
22.1K
David Nintang
David Nintang@davidnintang·
@_catwu Being able to view the prompt content of the subagent as well as the work it’s doing is also pretty neat
English
0
0
0
8
David Nintang
David Nintang@davidnintang·
@_catwu I actually love it! The highlights for me are geeing which sub agents, and tasks are running, and how many of them are complete.
English
1
0
0
231
cat
cat@_catwu·
Over the past few weeks, I’ve become a daily user of Claude Code on desktop. It’s the best way to kick off and manage multiple CC sessions across local and cloud in one place. You can also see git status, pin active sessions, and drag and drop layout to view multiple sessions at the same time! Let us know what you think :)
Anthony Morris ツ@amorriscode

Today we're launching a rebuilt version of Claude Code on desktop. The app has been redesigned for the ground up to make it easier than ever to parallelize work with Claude. I haven't opened an IDE or terminal in weeks. Excited for you all to give it a shot!

English
42
27
361
52.5K
Hubert Thieblot
Hubert Thieblot@hthieblot·
pitch me your company in 1 word.
English
2.5K
14
1.1K
287.4K
David Nintang retweetledi
David Evans
David Evans@daredevildave·
Today, we’re launching @autoaicam, a camera that builds personal apps for anything you point it at. How does it work? - Take a photo - Auto picks a Frame, a mini-app built and designed by you or our community - The Frame does something for you: track calories, virtually try on outfits, identify a plant, and much more How many of you have a camera roll full of photos that are really actions or reminders? Auto turns these photos into something useful.
English
58
35
436
161.7K
David Nintang
David Nintang@davidnintang·
A cheat code to life is being delusional
English
0
0
1
22
David Nintang retweetledi
Z.ai
Z.ai@Zai_org·
Introducing GLM-5.1: The Next Level of Open Source - Top-Tier Performance: #1 in open source and #3 globally across SWE-Bench Pro, Terminal-Bench, and NL2Repo. - Built for Long-Horizon Tasks: Runs autonomously for 8 hours, refining strategies through thousands of iterations. Blog: z.ai/blog/glm-5.1 Weights: huggingface.co/zai-org/GLM-5.1 API: docs.z.ai/guides/llm/glm… Coding Plan: z.ai/subscribe Coming to chat.z.ai in the next few days.
Z.ai tweet media
English
551
1.3K
10.9K
4.3M
David Nintang
David Nintang@davidnintang·
One skill I envy most is writing… like GOOD writing
English
0
0
1
22
David Nintang retweetledi
Aravind 🌍 🛰
Aravind 🌍 🛰@aravindEO·
@eternaltxts Write as often as you can (without AI) either publicly or just for yourself - that makes you think better and keeps you focused. Read as much as you can - that gives you more to think about and make you write better.
English
4
17
215
16.6K
David Nintang retweetledi
Advik Jain
Advik Jain@advikjain_·
@eternaltxts take any particular hobby you have and try to make $100 with it this month. not with the goal to start a business, just to learn what it feels like to try to get a stranger to pay you. it'll rewire your brain
English
0
5
137
12.3K