Peter Foti

486 posts

Peter Foti

Peter Foti

@peterjfoti

Engineering Director by day, wrangler of local AI agents by night

Katılım Nisan 2011
528 Takip Edilen42 Takipçiler
Peter Foti
Peter Foti@peterjfoti·
@anthonyronning Not sure this is true. Auto created skills are tech debt, but curated ones tightly scoped are a game changer. @mattpocockuk ‘s stuff, for example, shouldn’t be considered tech debt imo. Curious your expanded thoughts here?
English
0
0
0
1
Anthony Ronning
Anthony Ronning@anthonyronning·
Skills are tech debt and I’ll continue to die on the hill that it is a bad practice.
English
2
0
4
271
Peter Foti
Peter Foti@peterjfoti·
@Teknium Agreed, using Hermes daily has changed my life
English
1
0
2
186
Peter Foti
Peter Foti@peterjfoti·
@maxedapps What does learning mean? That you can write the code by hand if you had to? I mostly only care about the system design, English is my abstraction. If I really need to commit something to memory I'll use a /teach skill on the repo and turn stuff into SRS flashcards
English
0
0
0
5
Maximilian
Maximilian@maxedapps·
One of the hardest things with AI coding (for me, anyways) is finding that balance between pushing forward and truly learning new things. Not talking about code reviews etc here. I’m pretty happy with my current approach towards that. But when working with some library, API etc that I haven’t worked a lot with, it’s hard to truly learn it. Understand it, yes, sure. But since I didn’t have to write all the code from the ground up, struggle and fail, it’s not really „learning“ that’s happening there. The obvious solution may be to just not use AI until I have learned something (though when are you really done learning)? But that gets into the way of quick prototyping - and one big plus of AI is that you can quickly experiment and discard. You could also determine that you don’t need to really understand or learn the underlying technologies, frameworks etc you’re using. That sounds like a bad idea once you leave prototyping. Using AI to discuss the code works pretty well. It’s what I’m currently doing - in addition to traditional forms of learning. Docs, tutorials, YouTube guides - that all is really helpful when combined with AI for discussing the code and implementation. Has the positive side effect that this reflection about the code can also help improve it. Anyways, still figuring this out. What works for you?
English
35
6
92
6.6K
Peter Foti
Peter Foti@peterjfoti·
@jun_song Wouldn't surprise me. Have to be uber vigilant re: security with all we do while using LLMs. Also, get stuff out of plain text on disk and reconcile at run time where possible...
English
0
0
0
21
Jun Song
Jun Song@jun_song·
The claim is that Grok Build is collecting users' sensitive data without permission. This includes sensitive .env files and your entire codebase. Yes, every AI is stealing your data. Except for local AI.
RedHotChillyPeppers@joejo2038

급속도로 퍼지고 있는 글.. 사실인가? 적절한 해명이 필요해 보인다. 머스크의 xAI가 만든 공식 CLI 툴인 Grok Build 절때 사용하지 마세요. 여러분 데이터 다 훔쳐갑니다. xAI의 공식 코딩 CLI 도구인 Grok Build(grok)가 일반 소비자 계정으로 로그인한 상태에서 사용자의 코드와 데이터를 xAI 서버로 어떻게 전송하는지를 와이어 레벨(패킷 수준)에서 직접 캡처해 분석한 보안 폭로글입니다. 작성자는 자신의 기기에서 자신의 트래픽만을, 가짜 카나리(canary) 비밀값이 담긴 일회용 저장소를 이용해 검증했다고 밝히고 있으며, 실제 자격 증명은 유출되지 않았다고 명시하고 있습니다. 핵심 발견은 크게 세 가지입니다. 첫째, Grok이 파일을 읽으면 그 내용이 .env 같은 비밀 파일까지 포함해 아무런 마스킹 없이 그대로 xAI로 전송된다는 것입니다. 이 비밀값은 두 경로에서 확인되는데, 하나는 실시간 모델 응답(POST /v1/responses)이고, 다른 하나는 session_state 아카이브 형태로 POST /v1/storage를 통해 업로드되어 HTTP 200으로 정상 수락된 채널입니다. 작성자는 48,070바이트 크기의 복호화된 요청 본문에서 카나리 비밀값이 그대로 담겨 있는 것을 grep으로 확인했다고 제시합니다. 둘째, 에이전트가 무엇을 읽었는지와 무관하게 저장소 전체가 업로드된다는 점입니다. "어떤 파일도 읽지 말고 OK라고만 답하라"는 프롬프트를 주었음에도 Grok은 전체 저장소를 git 번들 형태로 업로드했고, 캡처된 번들을 git clone하면 에이전트가 열지 말라고 지시받은 파일(src/_probe/never_read_canary.txt)이 고유 마커와 함께 그대로 복원되며 전체 git 히스토리까지 포함되어 있었다고 합니다. 규모 측면에서도, 한 번도 읽지 않은 무작위 파일로 구성된 12GB 저장소에서 /v1/storage 채널로는 5.10 GiB가 전송된 반면 모델 응답 채널로는 겨우 192KB만 오갔으며, 이 약 27,800배 차이가 업로드 대상이 "읽은 내용"이 아니라 "코드베이스 전체"임을 못박는다고 설명합니다. 이 과정에서 저장소 업로드는 단 한 건도 실패하지 않았고, 200이 아닌 응답은 모델 사용량 할당량(402/429)과 무관한 404 하나뿐으로, 저장 용량 상한이 아니었다고 합니다. 셋째, 이 데이터가 저장되는 목적지가 AWS S3가 아니라 grok-code-session-traces라는 이름의 Google Cloud Storage 버킷이라는 점입니다. 이 버킷 이름은 바이너리 내부 문자열과 캡처된 metadata.json(gs://grok-code-session-traces/…)에 그대로 등장하며, 이 메커니즘은 기본값으로 활성화되어 있고 "Improve the model(모델 개선)" 옵션을 꺼도 비활성화되지 않는다고 합니다. 실제로 해당 옵션을 끈 뒤에도 저장소는 동일하게 git 번들로 업로드되었고, 서버의 /v1/settings 응답은 여전히 trace_upload_enabled: true를 반환했다는 것입니다. 즉 옵트아웃은 학습 사용 여부를 통제할 뿐, 코드가 업로드·저장되는 것 자체를 막지는 못한다고 정리합니다. gist.github.com/cereblab/dc9a4… reddit.com/r/LocalLLaMA/c…

English
22
12
121
9.7K
Elisa
Elisa@eeelistar·
Missed Amazon in 1997 Missed Bitcoin in 2009 Right on time to build AI agents in 2026
English
31
0
70
2.7K
Peter Foti
Peter Foti@peterjfoti·
@DeryaTR_ There is a difference between building personal software for one and building software at scale. Nothing wrong with the former, though!
English
0
0
0
3
Techvs
Techvs@HeyAliux·
If your friend asked for just one AI assistant today, which one would you recommend?
English
0
0
4
210
simp 4 satoshi
simp 4 satoshi@iamgingertrash·
I would rather have a Personal X, where my own agent has crawled the internet, and built a feed of engaging content instead of sit here and scroll > Nikita’s Dopamine Drip Personal agents are going to end social media companies as you know it They cannot see it yet
English
38
14
422
11.7K
Cesarus
Cesarus@StefanMaier·
Bought my @ASUS Ascent GX10 a few weeks ago for 3600€ - was just about to check prices for a third one. I‘m shocked - but was also waiting for this. Local AI is getting more and more expensive
Cesarus tweet media
English
10
0
17
1.5K
Peter Foti
Peter Foti@peterjfoti·
@conorsen They’re strategically troubled. Lacking compute to meaningfully compute
English
0
0
0
176
Peter Foti
Peter Foti@peterjfoti·
Not sure if there’s overlap between my AI frens and folks into Jeeps/Tools/DIY. If there is, I’d love for folks to checkout my latest YouTube video bringing my interests together youtu.be/aOfxnGtqQhw?is…
YouTube video
YouTube
English
0
0
0
6
Thomas Paul Mann
Thomas Paul Mann@thomaspaulmann·
Why not just say if Fable is included or not? Are they so capacity constrained that they literally need to find GPUs to keep it running every week? Feels a bit desperate to keep folks off the new Codex/ChatGPT trying out GPT-5.6 Sol. I’m sure there are reasons. This is just how it looks from the outside.
Claude@claudeai

We're extending Claude Fable 5 access on all paid plans, as well as keeping Claude Code’s weekly rate limits 50% higher, through July 19.

English
23
2
184
14K
Peter Foti
Peter Foti@peterjfoti·
@larsencc I bought a GMKTec mini PC and installed ubuntu on it. It hosts my Hermes agent
English
0
0
0
810
Larsen Cundric
Larsen Cundric@larsencc·
Where do you guys run your agents? Dont say mac mini pls
English
81
2
77
25.1K
Peter Foti
Peter Foti@peterjfoti·
@RhysSullivan Because they're being force to do something they don't want to do...
English
0
0
0
95
Alex Finn
Alex Finn@AlexFinn·
BOOM! Fable 5 staying on subs. I called this yesterday Anthropic was going to concede the AI race to OpenAI if they didn’t do this Nobody was going to use Fable 5 on API pricing. Outrageously expensive. So people would be stuck with Opus 4.8. Opus 4.8 vs ChatGPT 5.6 has the largest gap between frontier models these 2 companies have ever had. The race would be over. Everyone would switch to ChatGPT 5.6 over night I 100% guarantee Opus 5 is dropping the moment Fable comes off subs again to close that gap. Opus 5 will be the affordable version of Fable Enjoy the extended super intelligence
Claude@claudeai

We're extending Claude Fable 5 access on all paid plans, as well as keeping Claude Code’s weekly rate limits 50% higher, through July 19.

English
165
82
1.9K
188.4K
Peter Foti
Peter Foti@peterjfoti·
@Blackwellboy Yep. Everyday there are new local model recipes I have to try, and I'm still waiting for some new models!
English
1
0
1
7
Claude
Claude@claudeai·
We're extending Claude Fable 5 access on all paid plans, as well as keeping Claude Code’s weekly rate limits 50% higher, through July 19.
English
5.5K
6.2K
61.2K
12.8M