Post

Supreme Leader Wiggum
Supreme Leader Wiggum@ScriptedAlchemy·
Reading 5000 news articles is not actually that expensive. Hell, I had single threads that totaled 300 million tokens this afternoon alone. I need to ingest a total of 24,000 events. (Bluesky posts and news feeds) - the LLM converts this into a json object with various fields.
Supreme Leader Wiggum tweet media
English
4
1
10
1.4K
Supreme Leader Wiggum
Supreme Leader Wiggum@ScriptedAlchemy·
No. It converts posts and content into numerical representations for various algorithms which in turn are used to train model weights. Like novelty, expected decay, industry. I use embedders for creating clusters and vectors on the actual original text, but that’s not useing the stuff the LLM does.
English
1
0
1
70
Paylaş