Sabitlenmiş Tweet
Francis
4K posts
Francis
@dabblingfrancis
"Blow a kiss, fire a gun"
Belgium Katılım Haziran 2018
621 Takip Edilen292 Takipçiler
Francis retweetledi
Never forget that you are the main data center. Drink water, and consume as much literature as possible.
English
What is your theory for why LLMs lean so consistently on emdashes?
My top two:
1. Much of their training data is transcribed speech and humans speak in long, compound sentences.
2. There's a reward function, somewhere, that encourages the model to use fewer sentences.
English
@MaximeRivest i meant price for large tablets, love kindle paperwhite for novels
English
I did not expect e-reader to be above physical!!!
People love eink, yet they are not ubiquitous, what's missing?
Maxime Rivest 🧙♂️🦙🐧@MaximeRivest
If you had the printed newspaper, magazine, book, or any periodical with you, and you had it in e-ink/e-reader and you had it in your phone and on your laptop. What would you tend to use to consume that content?
English
Francis retweetledi
The fact that Agatha Christie had access to ChatGPT is undeniable proof that time travel is real
English
Francis retweetledi
Francis retweetledi
I would also add that good air conditioning units also operate as heat pumps in cold weather. Almost all modern hotel rooms are both warmed and cooled this way. Heat pumps are vital in getting people to heat homes electrically rather than using gas.
Second point. Never mind polar bears. Electrification is valuable simply because electrical devices are omnivorous and can use energy generated from any source. Gas boilers are like pandas: they can only run on gas/bamboo. This makes them vulnerable to bottlenecks, supply shocks, etc.
Greg Jackson@g__j
On the alleged battleground of air conditioning: 1) it is increasingly important in the uk 2) it’s the perfect complement to solar - great! Not too much in way of emissions - build more solar and more ac* 3) solar is very cheap if you can use when it’s sunny… ac is the perfect complement to solar too 4) it’s not banned here - but it should be more welcome (as should heat pumps) and some local authorities are a bit ott but local rules can be crazy all over the world - it’s illegal to pump your own gasoline in New Jersey, for example (here in Britain we are allowed to do it ourselves) 5) it’s pretty odd to argue that climate change isn’t real but also argue it’s increasingly important to have AC. And very fringe to argue that climate change is real but somehow a total coincidence wr to our emissions of greenhouse gases. 6) more ac with more solar could help reduce elec costs. We need more elec usage to spread the extortionate fixed costs over. Elec consumption is down 20% over 20 years.. * yes, I know that solar doesn’t work when it’s dark, whilst ac can still be needed. But other loads start to fall after 7pm. Domestic solar is now usually paired with domestic batteries too.
Sundridge, South East 🇬🇧 English
And despite all that loses miserably to France.
Now imagine being Diego Maradona..
Como Tanka o Bostil???@OFCBostil
Imagine ser o Erling Haaland por apenas um dia: > 1,95m >2k de testo > cidadão nórdico > toma banho gelado > come coração de boi no jantar >Hunter eyes > sem tatuagens > Gorilla hands > supermusculoso > parece ser um guerreiro da série Vikings > cabelos loiros naturais
English
@JustinBleuel @ChatGPTapp Displaying math equations Latex can be so slow sometimes (in Android)
English
Every bug in @ChatGPTapp is getting fixed
With the help of codex (and the rest of the lovely team and their codexes) along with a 7pm iced americano there will be zero bugs
This is a formal request for tiny nits, error states, broken ui, etc
The tinier the better!
Justin@JustinBleuel
@theOpusLABS @Fixlation7 @ChatGPTapp Yeah I do the same. Thanks again for flagging! fix for this is up and will go out soon 🙏
English
@SOURADIPCHAKR18 @lateinteraction @amritsinghbedi3 @NoahZiems Hello, thank you for this great blog post. This is a very refreshing take on improving RL sample efficiency.
It seems that for a given value of \beta, the teacher model can compensate for spikes by adding many predictable filler tokens. Have you noticed longer trajectories?
English
Francis retweetledi
🚨Typical RL algorithms and on-policy distillation methods are blind samplers: they use privileged info to score rollouts, but not to *find* them.
We ask: can we use privileged info to *actively sample* the rollouts RL wishes it can stumble upon with compute?
⤵️ Pedagogical RL
English
starting a challenge put your explanations below.
pracurser@PracurserTweets
@dosco Sowy.. but can someone explain RLMs to me pls ty 😭
English
Francis retweetledi
To further explain why I think your position is untenable:
AI can easily produce new fugues in the style of Bach and it's already hard (or will soon be) to justify that they could be "weaker" in objective dimensions. Yet I don't think you could become seriously interested in those fugues.
The reasons seems backstory-related:
1/ the backstory of authenticity, connecting the work to a specific person, from a specific century, at a certain moment in the history of music (this is the same reason that prevents neoclassical copycat for being seriously considered).
2/ the backstory of how you were connected to the fugues, at a certain moment of your cognitive journey. Your adult brain might be less willing to engage with new fugues with the same intensity...
3/ but it's likely to be different if you're fed a specific story that you buy into (eg, that the fugue is a lost work by Bach that was miraculously recovered.)
I even think this is testable, with a group of Bach lovers being presented the fake AI fugue as AI generated, and another group being told the "recovered lost work" story. I'm pretty certain the two groups would come up with very distinct esthetic judgments.
English
Francis retweetledi
Annoys me when people ask for additional reading, or challenge me with some billionaire's quote.
It's an example of today's lack of critical thinking and creativity.
Try thinking for yourself.
English
Francis retweetledi
@Porkchop_EXP QTing yourself with another visual banger. Extraordinarily powerful. Thank you for this masterclass.
English
Wow... Power training and longevity
Araújo et al. followed 3,899 people — mostly middle-aged and older adults — for a median of nearly 11 years. They compared two metrics head-to-head: muscle strength and muscle power.
Men in the lowest power category were nearly 6× more likely to die than those in the highest. Hazard ratio: 5.88. For strength alone, it was 1.62.
For women, low power was associated with almost 7× the mortality risk — a hazard ratio of 6.90 — while low strength was associated with a hazard ratio of 1.71.
mayoclinicproceedings.org/article/S0025-…
cc: @CoachDanGo @Michael_Easter
English
Francis retweetledi
I keep reading this take (below) every few months, presented as if extremely profound, and it is just offensively dumb. It confuses data and information, it ignores the fact that not all information is equally valuable, and it ignores the importance of retention rate.
As a thought experiment: if this were true, if your retina cell count were 10x greater, you'd be "trained on 10x more tokens" and therefore you'd be way smarter. Same if their firing frequency were 10x greater. With 10x more retina cells firing 10x faster you'd be "trained on 100x more tokens"!
Obviously this makes no sense -- the signal coming from these cells is extremely correlated over space and time, so their raw information content (what remains post-compression) is extremely low compared to the "raw bit" encoding. The human visual system actually processes 40 to 50 bits per second after spatial compression. Much, much less if you add temporal compression over a long time horizon.
Latest LLMs get access to approximately 3 to 4 orders of magnitude of information more than a human by age 20 (post compression in both cases). About O(10T) bits vs O(10-100B) bits.
And that's just *raw information* but of course not all information is equal, otherwise we wouldn't be spending tens of billions of dollars on training data annotation and generation. Plus, that's only *information intake* but of course humans have far lower retention than LLMs (by 3-4 OOM). You could write a short essay about how incredibly off the mark this take is.
English