
Christophe Henner
35.9K posts

Christophe Henner
@schiste
COO @Hyperlex_ - @Wikimedia at large - he/him
Paris انضم Mart 2007
1.5K يتبع2.9K المتابعون

@thsottiaux Even at 10x. The one and only real solution is to have products that consume compute off peak time.
And if possible to other demographics. The one you are talking to have all the same usage need and patterns.
English

@thsottiaux I wrote about it a couple of weeks ago open.substack.com/pub/schiste/p/…
GPU peak time is a nightmare to manage. Tech solutions are seldomly doing a tent and usually come with a set of downsides too.
More usage off peak time creates more usage overall and not less at peak time.
English

With Codex the there is quite the gulf in load between peak and off-peak times, and we would like to achieve more of a smoother traffic pattern as that would be a more optimal use of our compute.
We have ideas, but curious what you all think we should do? Would more usage during off-peak and surge multiplier during peak times make sense?
English

@thsottiaux GPU peak time management war :) been there back in the days with @Shadow_NA
Enjoy, it was as infuriating as it was exciting to dive that low in the stack to reclaim minutes of compute at peak ^^
English

Our Codex dashboards are showing increased rate of users hitting rate limits and since we don't fully understand why I have made the cautious decision of resetting the usage limits for all plans. Enjoy.
I also wanted to celebrate us finding a pocket of fraudulent accounts that we banned and have helped us regain some compute. The fight against abuse never stops, but it's important to mark the moment and make it a little shared victory.
English

@rohanvarma With a slow mode I would launch tasks and « forget » knowing it would take longer.
It would allow to push forward on some topics without the cognitive load of running n projects at a fast pace in parallel
English

@rohanvarma Large codebase quality assessment. Large boring refactors that cannot be done cleanly with scripts but Codex can go through.
Data cleaning / enrichment.
Actually even on actual features, I have some projects I would love to have a slow mode just to lessen mental load.
English

@LionelMiraton Le $0 est parce que le calculateur déconne, il faut que je corrige le bug.
Ca inclut les cached tokens, 30% environs.
Filer de l'IA aux gens qui sont hyperactifs est clairement une mauvaise idée...
Français

@johnhelmuth_ @Al_Grigor Nope, OpenAI is working with a more diverse user base meaning their spread between peak time and low point is smaller.
All issues are related, peak time management is insane to manage when it’s so concentrated and you operate GPUs. open.substack.com/pub/schiste/p/…
English

@Al_Grigor We’re starting to see the downside of a company that ships as fast as they do.
They lose stability and reliability.
OpenAI has taken the complete opposite approach.
Anthropic stays in the news cycle, for better or worse.
OpenAI keeps on chugging for a billion users.
English

@eparody Ha non même pas. S’ils avaient le choix ils feraient pas ça. Quand tu sers pas 7% des demandes ça veut aussi dire que ça impacte les calls APIs et que derrière tu as du down en cascade. Un enfer à gérer
Et pour déployer de la capacité en plus de celle prévue, tu en as pour 3 mois
Français

Et voilà :D

Christophe Henner@schiste
Les quotas Claude qui fondent ce n’est pas un bug mais une feature. J’ai traduit mon gros article en français pour les personnes courageuses de lire l’explication : schiste.substack.com/p/probleme-de-… Et Anthropic ne communique pas sur ce sujet parce que c’est toujours temporaire.
Français

@edsocra They don’t have a choice, it’s peak time management open.substack.com/pub/schiste/p/…
English

You’re going from rewarding users using it during off-peak hours (double usage which ends March 28th) to punishing them for using during peak hours.
I think that’s a terrible move if you want happy customers.
Thariq@trq212
To manage growing demand for Claude we're adjusting our 5 hour session limits for free/Pro/Max subs during peak hours. Your weekly limits remain unchanged. During weekdays between 5am–11am PT / 1pm–7pm GMT, you'll move through your 5-hour session limits faster than before.
English


@benjaminhaddad Et bien d’autres actions créés un environnement très régulé mais qui oblige l’argent à rester aux US.
Vous voulez des nvidia ? Oblige la commande publique à ne travailler qu’avec des acteurs européens.
Juste ça et on change le panorama européen en 3 ans.
Français

@benjaminhaddad Non. C’est faux. Les US régulent justement beaucoup plus que nous mais pas les même choses.
L’obligation de commande publique uniquement aux US, les aides aux entreprises innovantes sans dossier à déposer, l’obligation de partenariat public privé dans la défense,
Français

Quand les autres ont innové, nous avons régulé.
Quand le reste du monde produisait des Nvidia, des ChatGPT ou des BYD, les Européens produisaient des CSRD, RGPD ou IA Act.
Pas de souveraineté sans innovateurs et entrepreneurs. #Senat
Français

Les quotas Claude qui fondent ce n’est pas un bug mais une feature.
J’ai traduit mon gros article en français pour les personnes courageuses de lire l’explication : schiste.substack.com/p/probleme-de-…
Et Anthropic ne communique pas sur ce sujet parce que c’est toujours temporaire.
Français

@thenowhereway Unless you consider refactoring part of the process and do it on a weekly basis. It is insane to think like that with humans code producers but with AI it’s almost part of the ci cd
English

@val_strch @steashaz C’est un papier d’opti hein pas un changement de paradigmes. C’est une super option par contre.
Français


@ashen_one It’s not a glitch it’s peak time management open.substack.com/pub/schiste/p/…
English

I have two Max plans, one at $100/m and another at $200/m
Both hit their session limits within like 2 hours of usage
i didnt even do anything crazy with them lmfaoo
theres def a glitch happening today (i doubt it was intentional)
Tom Osman 🐦⬛@tomosman
Yo @AnthropicAI why are you pillaging everyone's usage. Has it been greatly reduced without telling anyone?
English

@VadimStrizheus It’s peak time management. If love long articles i explain it all there open.substack.com/pub/schiste/p/…
English

did Anthropic drop a secret update?!
So I’ve hit my 20x max plan limit 30 minutes ago, and normally the extra usage cost would be going down.
but so far it’s been stuck at $28.22 for almost half an hour now.
maybe the team “extended” the limits past 100% or I might get slapped with a huge bill.
Lmk if yall are experiencing this. 👇
English








