Teles🌻

Fiz uma cena Uma app mais simpática para as bikes Gira em Lisboa Temos release para Android! iOS futuramente!

@EricParker @theo I saw down in the comments that maybe perhaps they could be overbatching by default in order to get more tokens/Joule? This would mean leaving memory bandwidth on the table, but it also means you have to do less reads per token which uses less power per token!

@EricParker @theo I think this image is more illustrative, batch size batch size 1 only gives you best case 36% lower time per token vs batch 16. I do not think OAI is doing this drastic of a batch change, and they have more than 36% improvement.

Can someone smarter than me explain how these “turbo mode” things work on like an implementation level? Are they using better GPUs? More GPUs? Reserved allocation during generation?

@mweinbach @theo Hmmmm, maybe leaving memory bandwidth on the table helps tokens/Joule? I thought about it some more and am less certain. Still weird!

@mweinbach @theo This completely disregards the shared memory bandwidth within the batch. For this to work openai would have to be overbatching by default, which would mean they were leaving memory bandwidth on the table by default which probably isn't true?

@theo @EricParker I don't have the answer but unless I am misunderstanding something, this has nothing to do with it. Turbo mode increases throughput on a single session, I'm not sure if it affects latency at all.

@theo @EricParker I don't think this is the answer you were looking for, this compares latency to total throughput! It says nothing about a single session's throughout! src: databricks.com/blog/llm-infer…

@skylermzx @awawawhoami @N104AP That's okay you can wait 24h or adb your own device with termux

@awawawhoami @N104AP Not everyone has a pc

"but the 24 hour wait is a one time thing" imagine you bought a laptop and couldnt install any apps that werent from its OS' app store for an entire 24 hours. you would be pissed wouldn't you? even on iOS you can sideload immediately, good lord

they taught us payment cards have a check digit in elective computing class when i was 14 i was like "i love learning about the world in class. i bet boyinaband is seething rn"

@Kisson_thelips @ratlimit Yes because this is a real email exchange

@ratlimit Lol there's an actual hiring manager named Rebecca at Apex

Pretty interesting discussion with a hiring manager today !

@catgirlprostate Outer wilds mention

The kinda guy who just buys whatever is in the top banner of the playstation store and has never scrolled down

@NeogiClaws @LifeIsButACrow @ireverents You cannot, if a person can read it a bit can read it.

@LifeIsButACrow @ireverents Like please give me a not bad way that actually works before you start complaining about what writers do to protect ourselves from thieves. Because right now the only actual solution I can see is simply not to post, but I guess that's what fandom wants.

i'm sorry to be the annoying dev in the qrts but this does nothing. AI scrapers work by getting the HTML from ao3. you can even get it yourself by pressing (F12) on your browser. all the text is copy and pastable there even if you turn selection off for the user interface

@SilicatYT in math civilisation we use clouds to do floating point calculations

@oomfatuated why are ur takes so goated

what native-exclusive affordance is this even trying to show lol

@JF_IEC @Joaogalamba Não é a minha experiencia, tenho tudo COPs acima de 4 tanto no verão como no inverno.

@teles_dev @Joaogalamba Esses scop são em condições ideais, na prática do dia a dia ronda 2, instalações existentes podem não estar otimizadas para BCs, tempo de aquecimento, comportamento em baixas temperaturas no inverno, manutenção cara e complexa. Faz sentido em algumas situações noutras nem tanto.

A tecnologia mais eficiente para aquecer…e arrefecer, porque as bombas de calor fazem as duas coisas. E com um COP standard acima de 3, mesmo só para aquecer, o gás teria de ser pelo menos 3 vezes mais barato para fazer sentido.

@JF_IEC @Joaogalamba Porque não?

@Joaogalamba Na teoria sim, na prática não é bem assim..

@KelseyTuoc @DeptofWar Perhaps a misunderstanding reference to Claude's SOUL.md? Maybe someone told him Claude had a soul file and this is how it was interpreted.

@DeptofWar Does he in fact believe that Claude has a soul, or is that a misunderstanding?

The Undersecretary's own words here on X were "Are you saying that a frontier model that has a soul, a constitution, a preference for non-western values and embedded personal principles is no different than all the others which @DeptofWar has come to agreement with?"

My ancestors buried half their children. All mine are alive. My ancestors' house had a dirt floor. Mine is wood. I have indoor plumbing, I have hot water, I have never in my life hauled a full bucket half a mile and I probably never will. Do you know how rare it is, in human history, for small children to wear shoes? Mine have multiple pairs. I can speak to my relatives who live thousands of miles away, for free, at any time. Video, if we want video. With machine translation, if we speak different languages. The original Library of Congress had 740 books in it. I have more than that. If I run out of books in my home my local public library has 350,000. If I want to take a hundred books with me on vacation, they all fit on a device that fits in my purse. I have heat in the winter and AC in the summer and a washing machine and I have never, ever, ever had to scrub a dress clean by hand in the stream. I can look up recipes from more than a hundred different countries and I've tried dozens of them. I ride a clean and modern train across my city for $4, or take a robot taxi if I'm out too late for the train. I donate $40,000 every year to the cause of getting healthcare to the world's poorest people and even after the donations I never have to think about whether I can afford a book, or a pair of shoes, or a cup of coffee. There is a great deal more to fight for, of course. I hope that our descendants will look back on our lives and list a thousand ways they're richer. Maybe we ourselves will do that, if some of the crazier stuff comes true. But the abundance is all around you and to a significant degree you aren't feeling it only because fish don't notice water.

Ministra tendencialmente bem

@grrlCockpit "Nós temos muito potencial renovável, já o investimos e, portanto, a nossa aposta deverá ser nas renováveis" Ya solar é baratissimo (mais que nuc), e temos mto bom clima, that's kinda it

estou-me bem a foder, deixem espanha atingir 100% renováveis/nuclear e comprem-lhes tudo ao menos assim temos a certeza que é infraestrutura séria

@hipoderme Look dms

@teles_dev merda para o immich…….

que secaaaaaaaaaa😭😭😭😭😭😭😭😭😭😭😭😭😭😭😭