Jari Bakken

2.5K posts

Jari Bakken banner
Jari Bakken

Jari Bakken

@jarib

Programmer, guitarist, open source enthusiast. Newsroom engineer at @vgnett. Exploring how to use AI/ML for journalism.

Oslo, Norway Katılım Nisan 2008
1.9K Takip Edilen1.3K Takipçiler
Jari Bakken
Jari Bakken@jarib·
@lateinteraction Knowing a goal doesn’t count has _having_ a goal. Purpose is what gives knowledge direction/orientation. There’s a distinction between _knowing_ and _caring_. The goal must matter to you.
English
0
0
0
65
Omar Khattab
Omar Khattab@lateinteraction·
@jarib A concrete purpose is part of intelligence? In that case, is it just part of knowledge?
English
1
0
0
276
Omar Khattab
Omar Khattab@lateinteraction·
Once you subtract factual knowledge, intuition (heuristic knowledge and skill), and compute (the capacity to execute systematic search), do any other parts of intelligence remain?
English
15
4
68
7.8K
Simon Willison
Simon Willison@simonw·
First impressions of GPT-4.5 (via the API) is that it feels surprisingly slow
GIF
English
35
16
312
99.8K
Ruben Mathisen
Ruben Mathisen@rubenbmathisen·
This is still a working paper so any comments are very much welcome.
English
21
4
210
22.6K
Andrej Karpathy
Andrej Karpathy@karpathy·
It's a bit sad and confusing that LLMs ("Large Language Models") have little to do with language; It's just historical. They are highly general purpose technology for statistical modeling of token streams. A better name would be Autoregressive Transformers or something. They don't care if the tokens happen to represent little text chunks. It could just as well be little image patches, audio chunks, action choices, molecules, or whatever. If you can reduce your problem to that of modeling token streams (for any arbitrary vocabulary of some set of discrete tokens), you can "throw an LLM at it". Actually, as the LLM stack becomes more and more mature, we may see a convergence of a large number of problems into this modeling paradigm. That is, the problem is fixed at that of "next token prediction" with an LLM, it's just the usage/meaning of the tokens that changes per domain. If that is the case, it's also possible that deep learning frameworks (e.g. PyTorch and friends) are way too general for what most problems want to look like over time. What's up with thousands of ops and layers that you can reconfigure arbitrarily if 80% of problems just want to use an LLM? I don't think this is true but I think it's half true.
English
564
1.2K
10.6K
1.3M
Jari Bakken
Jari Bakken@jarib·
@simonw @JeremyNguyenPhD Seems to me the regular ChatGPT upload switches to some sort of RAG if the document is large enough. I just tried a 1.3 million token document and it replies with things like "let me search for …" etc. Definitely no OCR/vision though. Does it do image OCR with Knowledge?
English
2
0
3
160
Simon Willison
Simon Willison@simonw·
I don't think it's appreciated enough that ChatGPT is absolutely a power-user tool It's like Excel: getting started with it is easy enough, but truly understanding it's strengths and weaknesses and how to most effectively apply it takes years of accumulated experience
English
54
71
936
374K
Jari Bakken
Jari Bakken@jarib·
@helmers Kommer litt an på hvilket prosjekt du er interessert i? Bare ta kontakt på DM hvis du står fast på noe
Norsk
0
0
4
13
Jari Bakken
Jari Bakken@jarib·
@BritiskV @olavtorvund @Meteorologisk SeNorge er en modellinterpolering over de tilgjengelige målestasjonene. Tror ikke det finnes noen bedre måte å løse dette på, men er åpen for innspill.
Norsk
1
0
0
59
SLAVA MORE!
SLAVA MORE!@BritiskV·
@jarib @olavtorvund @Meteorologisk Den er svært vanskelig siden tids spennet som dere har brukt, er den tidsperioden byene i Norge begynte å vokse. Lokalkunnskap vil være en faktor, men plassering av målere er alfa og omega. Særlig hvis vegvesenet sine sensorer skal brukes. Asfalt og varme biler........
Norsk
1
0
0
70
SLAVA MORE!
SLAVA MORE!@BritiskV·
@jarib @olavtorvund @Meteorologisk Takk for svar, men jeg ser noen svakheter med dette. Min nabokommune Flekkefjord, har siden slutten av 70 tallet fått mange nye boligfelt i åsene rundt byen. Folkemassen har derfor flyttet til høyere, mer solvendte plasser, kontra bykjernen ved havoverflaten.
Norsk
2
0
0
111
SLAVA MORE!
SLAVA MORE!@BritiskV·
@jarib @olavtorvund @Meteorologisk Hei, spørsmål: Hvor blir disse målingene gjort i de respektive kommunene? Er det mulig med å legge ut et kart på hvor disse punktene befinner seg?
Norsk
2
0
0
1.2K
Jari Bakken
Jari Bakken@jarib·
Det er fortsatt ganske ustabil teknologi. Den roter seg bort i helt feil tabeller og tryner ofte fordi kontekstvinduene er for små. Men synes det viser noe av potensialet i språkmodellene når de får en avgrenset verden å jobbe innenfor.
Norsk
1
0
4
707
Jari Bakken
Jari Bakken@jarib·
Jeg har laget en AI-assistent som leter frem tall hos @ssbnytt og er helt fascinert av å se den prøve og feile
Norsk
2
1
37
5.8K