MOIKAPY

24.6K posts

MOIKAPY banner
MOIKAPY

MOIKAPY

@moikapy

SWE Gamer → Tinkerer → 3D Print Alchemist Maker at @moikas_official Watch on YouTube, Twitch, Kick, and X Creator of https://t.co/ntO200H3wP

Beigetreten Temmuz 2019
756 Folgt895 Follower
Mario Zechner
Mario Zechner@badlogicgames·
People of pi. I'm considering adding a /submit-data-to-mario command. here's why and how. please read and take part. i know it's a lot of text. 🥧 POLL IN NEXT POST, PLEASE VOTE! pi has an edit tool. that tool let's the agent edit a file by specifying an old string which is to be replaced by a new string. this edit tool performs surprisingly OK across many models. but it's not perfect. for example, gpt 5.4 isn't amazing at using it, while weirdly enough gpt 5.3 codex mostly is. i'm considering a new default edit tool implementation that lets the agent specify multiple old/new string replacements in one tool call. i've seen this perform better with gpt 5.4 based on vibes on my code bases. but that does not mean it will perform better with other models on other code bases. i would thus like to try the following experiment: 1. implement the new edit tool 2. add a /send-mario-data slash command 3. add a weekly reminder asking you to manually trigger /send-mario-data which you can turn off immediately the first time the reminder is shown to you, or anytime via settings the slash command would: 1. scan your sessions from the past 7 days in ~/.pi/agent/sessions for edit tool calls, what provider/model emitted the tool call, how many replacements where emitted, the file extension (e.g. ".ts", ".c") and whether the tool call succeeded, and the pi version 2. it would aggregate this tool call data per provider/model. this let's me see which models fail how often using the new edit tool, and if that's related to the number of replacements it is trying to make per tool call 3. it would show you the exact data that will be submitted to my server at pi.dev and stored there before anything is sent, with a cancel and send button the data will include a uuid (stored in ~/.pi/agents/id.json), so i can track performance over time from the same source. the data will NOT include: 1. any PII, including your ip 2. any actual file paths, old strings, new strings 3. any other information other than what is stated above exactly. this aggregate data will then be available to everyone on the web and will help me improve the edit tool in general, or for some specific models. by publishing this data for everyone, other coding harness maintainers can also benefit (hopefully). pi has zero telemetry becaude i myself despise telemetry. that also means i'm flying blind wrt how the edit tool works with models (and programming languages) i do not use. other coding harnesses are instrumented up the wazoo and have all this data (some without pii removal or aggregation). which kinda puts pi at a disadvantage. i also think that this kind of aggregate data being available can contribute to building open datasets all of us in the coding agent space can benefit from (yes, i'm a dirty hippy who dislikes duopolies). TL;DR: would you supoort this effort and voluntarily contribute such aggregate data on an entirely manual and opt-in basis? (i would also like to learn about anything you think is wrong with the scheme i outlined above! post below)
English
30
8
187
13.1K
MOIKAPY
MOIKAPY@moikapy·
@badlogicgames Why not a general /telemetry that turns it on or off and default off for new users
English
0
0
1
125
MOIKAPY
MOIKAPY@moikapy·
@badlogicgames I have a couple internal extensions similar to this. Been using Pi to make my own openclaw. So far I feel pretty close with my gateway + heartbeat. Needs more testing and work tho. Homie is connected to the discord, we need to make sure chats work
English
0
0
0
124
MOIKAPY
MOIKAPY@moikapy·
Sad day... Can't use the @ElevenLabs API/SDK with their new market feature.
English
0
0
0
12
MOIKAPY
MOIKAPY@moikapy·
I wish @midjourney had an API we could use with our subscriptions.
English
0
0
0
14
ElevenLabs
ElevenLabs@ElevenLabs·
Introducing the Music Marketplace in @ElevenCreative. Creators, artists, and musicians can now publish and earn from their tracks created with our music model.
English
69
408
740
196K
MOIKAPY
MOIKAPY@moikapy·
The Kobolds now have context for their devices, and for the time. I added an inner monologue module, and it kept asking for more context of its environment, so we added it.
English
0
0
0
9