Erik Hornberger

9/11だけではありますが、Foundation Model フレームワークのエンジニアも参加してくれることになりました。もし直接エンジニアと話したいって方は9/11にぜひご応募ください。また、9/9,10の枠も、もちろんお待ちしております。

If you’re passionate about the intersection of AI and API design, there is arguably no better team than this one. Opportunities to be part of something this big are few and far between.

The update also contains optimizations to the inference stack that improve token throughput. I'm curious to see how noticeable the difference is in your use cases. (6/6)

GeneratedContent is no longer opaque. It now has a kind property that you can inspect. This makes it possible to create views that display arbitrary generated content, which can be useful when working with user configurable generation schemas. (5/6) developer.apple.com/documentation/…

iOS 26 Beta 5 dropped today and contains some exciting additions to the Foundation Models framework. (1/6)

@bdkjones @_julianschiavo Yes, it put it in a Task and cancel the task!

@_julianschiavo Does LanguageModelSession respect Task.isCancelled? Or is there some other way to cancel a session that's streaming a response before it finishes?

Very clever idea, I love to see stuff like this! You can also add a slider to your preview view to scrub back and forth across different degrees of partially generated states. artemnovichkov.com/blog/working-w… by @iosartem

@winstondu Thanks for the report!

FB18746126

Generable macro should add an @available(iOS 26.0, *) wrapper I want to mark data models across my app as Generable Right now I’m forced to maintain two parallel model definitions, drop older OS support, or manually write out the conformance (defeats the purpose) @mopperson

@rudrank Thanks for filing feedback!

@mopperson Thank you for fixing it!

I wanted to create a package FoundationModelsTools but @ Generable macro has an issue with public visiblity as the id needs to be public as well 🙁 Hopefully it is fixed in beta 2 (need to file a feedback as well)

@bilqisium @NatashaTheRobot Thank you!

@mopperson @NatashaTheRobot Thanks Erik! About the tool calling being affected by the generating type, is it a known issue? Do I need to file a feedback?

I am beyond honored and humbled by the opportunity @NatashaTheRobot gave me in making this guest post. I've read her since the days of very early Swift. Explore tool calling in Apple's new Foundation Models, with an agentic architecture and nested LLMs, pushed to the limit!

@bilqisium @NatashaTheRobot Please file feedback for that. If you have specific prompts that you can include for us to repro, that would be very helpful. Seed 3 should have a new session.dumpFeedbackAttachment() that you can use to capture the transcript in a json file that you can attach!

@NatashaTheRobot Great write up! First I’ve seen the recommendation to put reasoning before classifications and use structured concurrency. 👍👍 A small optimization is to use an enum for the classification. After the first token, the label is deterministic, so we can skip computing the suffix!

New Blog Post: How to Add Custom Guardrails to Your FoundationModels Generation Learn how to add custom guardrails to Apple’s on-device FoundationModels framework to validate and filter user input using structured prompts and model-generated reasoning. Link below in comments!

@irangareddy @azamsharp @generable There is a type named DynamicGenerationSchema that exists specifically for expressing schemas that are constructed at runtime instead of compile time. It’s a little more typing, but can be very powerful.

@azamsharp @generable Is there any possibility to update guided generation dynamically to control?

One important thing to keep in mind when using @Generable types is that the model will generate all properties defined in the struct—even if you only display a few of them in your UI. For example, if your view only shows the recipe’s name, description, and prepTimeMinutes, the model will still generate the full ingredients list behind the scenes. This can lead to a noticeable delay or a “stuck” feeling in the UI, especially since you're not rendering the ingredients and users may wonder why it's taking so long.

@gyin94 @normarayr Also, the entires Transcript type is Codable, which is an even easier way to persist and restore sessions.

@gyin94 @normarayr It’s a known bug — we listed it in the release notes.

Apple Foundation Models team, please explain to me WHY every Transcript.Entry has a public initializer except Transcript.ToolCall? Why do you have to be like this ^:( How am I supposed to initialize this to restore a saved conversation?