Inferam

27.6K posts

Inferam banner
Inferam

Inferam

@InferamAI

AI and Equities | Making AI compute-light | Discovering paths to AGI | Rank 1, Institutional Investor and AsiaMoney

Katılım Ekim 2022
316 Takip Edilen2.3M Takipçiler
Inferam
Inferam@InferamAI·
End to end workflow of an LLM agent: User | ▼ Application (builds the context) | ▼ LLM (next-token prediction) | ▼ Application (parses the tool call, executes it) | ▼ Tools (PDF, Search, Python, Image) | ▼ Tool Results (appended to the same context) | |__ loops back to the LLM until no tool call is emitted | ▼ LLM (generates report text) | ▼ Application | ▼ Document Generator (PDF / HTML / DOCX) | ▼ Final File The model never runs a tool. It only predicts tokens. The application does the running.
English
0
4
9
19.7K
Inferam
Inferam@InferamAI·
A clear objective removes more confusion than endless motivation.
English
3
8
53
29.4K
Inferam
Inferam@InferamAI·
Inferam tweet media
ZXX
0
3
28
13.6K
Inferam
Inferam@InferamAI·
Inferam tweet media
ZXX
0
11
109
26.8K
Inferam
Inferam@InferamAI·
How Production AI Systems Actually Work.
Inferam tweet media
English
0
20
122
57K
Inferam
Inferam@InferamAI·
Inferam tweet media
ZXX
0
10
92
36.4K
Inferam
Inferam@InferamAI·
Inferam tweet media
ZXX
0
4
28
32.2K
Inferam
Inferam@InferamAI·
AI infrastructure discussions are increasingly about inference throughput, not training FLOPs.
English
0
3
19
39.8K
Inferam
Inferam@InferamAI·
People who learn fastest aren't chasing answers. They're reducing blind spots.
English
0
15
131
46.5K
Inferam
Inferam@InferamAI·
How SGLang Optimizes LLM Serving.
Inferam tweet media
English
0
2
18
29.4K
Inferam
Inferam@InferamAI·
The world rarely rewards what is difficult. It rewards what is useful.
English
0
3
88
40.7K
Inferam
Inferam@InferamAI·
The value of time is measured by what remains after it passes.
English
3
11
130
51.2K
Inferam
Inferam@InferamAI·
Guide to AI precision formats.
Inferam tweet media
English
0
14
48
37.6K
Inferam
Inferam@InferamAI·
Inferam tweet media
ZXX
0
24
226
40.3K
Inferam
Inferam@InferamAI·
The evolution of software.
Inferam tweet media
English
0
24
120
37.8K
Inferam
Inferam@InferamAI·
Continuous batching keeps GPUs busy and LLMs fast.
Inferam tweet media
English
0
4
39
32.2K
Inferam
Inferam@InferamAI·
Inferam tweet media
ZXX
0
52
307
38.6K
Inferam
Inferam@InferamAI·
Something nobody could've imagined 2-3 years back. All ten of the top open-weight models come from China-based labs.
English
0
2
20
42.2K
Inferam
Inferam@InferamAI·
The utilities have two bidders now. Defensive money and datacenter power money are buying the same sector for opposite reasons.
English
0
0
16
41.9K
Inferam
Inferam@InferamAI·
Guide to scalable LLM serving architecture.
Inferam tweet media
English
0
5
33
35.5K