Mattt

I'm thrilled to announce my collaboration with @huggingface to help developers bring AI directly to users — on their own devices, on their own terms 🤗 We'll be working together to build tools & Swift packages to make things better, and writing guides that make things clearer.

Apologies to anyone impacted by yesterday's outage. I'm taking it as an opportunity to shore up the infrastructure — adding the kind of things you'd expect for a production deployment (synthetics, alerting, etc.). It's a curious thing about software, and really any shared endeavor: as something becomes depended upon by more people, the nature of what it demands from you changes. It's silly for a hobby project nobody uses to have a lot of process. But at some point neglect stops being cool-kid pragmatism and becomes stubborn recklessness. What made you fast early on becomes a liability. It's a lot like growing up. You do it reluctantly, and usually because you learned something the hard way.

...which ironically would have been especially useful during the outage sosumi.ai had yesterday in the process of shipping the CLI 🫠 github.com/NSHipster/sosu…

sosumi.ai now has a CLI ``` npx @nshipster/sosumi fetch /documentation/swift/array ``` This lets you fetch and render  Developer content directly into LLM-readable Markdown, without connecting to a remote MCP server.

Today ggml.ai joins Hugging Face Together we will continue to build ggml, make llama.cpp more accessible and empower the open-source community. Our joint mission is to make local AI easy and efficient to use by everyone on their own hardware.

It's rewarding to see so many developers using sosumi.ai on the daily. Thanks for making it part of your regular workflow!

We want to be good citizens of the ecosystem, so sosumi.ai respects robots.txt on every external host. Site owners can opt out by disallowing the sosumi-ai user-agent. Full crawler policy and contact info: sosumi.ai/bot

By popular demand, sosumi.ai now supports externally-hosted Swift-DocC packages! swift-argument-parser (GitHub Pages): sosumi.ai/external/https… swift-composable-architecture (@SwiftPackages): sosumi.ai/external/https…

Other than that, this is getting pretty close to a feature-complete 1.0 release, I reckon. Big thanks to everyone who's opened issues and contributed PRs. If you hit any bumps or have anything you'd like to share, please reach out!

Next up: Improving guided generation with XGrammar. This release uses a hand-rolled implementation of constrained generation, but we do much better. I wrote a Swift wrapper around the C++ library and published it here: github.com/mattt/swift-xg… PR here: github.com/mattt/AnyLangu…

AnyLanguageModel 0.7.0 is here, with guided generation for all models — Core ML, MLX, llama.cpp, Ollama, OpenAI, Anthropic, Gemini — plus, a new Open Responses model, and a ToolExecutionDelegate for observing and controlling tool calls. Check it out! github.com/mattt/AnyLangu…

Just released AnyLanguageModel 0.6.0, with support for guided generation for MLX and Llama, custom JSON mode for Gemini, model prewarming for MLX, improved DeepSeek API compatibility, and the ability to create custom adapters in your own project. github.com/mattt/AnyLangu…

🎉 llama.cpp now has Ollama-style model management. • Auto-discover GGUFs from cache • Load on first request • Each model runs in its own process • Route by `model` (OpenAI-compatible API) • LRU unload at `--models-max` huggingface.co/blog/ggml-org/…

In my collaboration with @huggingface, I'm on a mission to make it easier to build apps that leverage local, open-source AI models. So much of this has been community-driven, and I really appreciate the feedback I've received so far. What would you like to see next?

I built this package in response to feedback we received about the HubAPI implementation in swift-transformers. Try swift-huggingface today, and stay tuned for its integration into swift-transformers in an upcoming release. github.com/huggingface/sw…

Introducing swift-huggingface: a complete Swift client for @huggingface Hub. • Fast, resumable downloads • Flexible, predictable auth • Sharable cache with Python / hf CLI • Xet support (coming soon!) huggingface.co/blog/swift-hug…

Just published an article on @huggingface's blog about AnyLanguageModel that goes into more detail about the motivation behind the library and what we're building toward: huggingface.co/blog/anylangua… 🆕 Be sure to check out our new chat-ui-swift example project (linked at the end)

@ErezHod @NSHipster Atom feed work alright? nshipster.com/feed.xml

@mattt Wish you had an RSS feed on @NSHipster ✨

@pj4533 @bcherny Sosumi currently serves text by default for docs. It'd be great if Apple's website supported Markdown automatically, but until then, we'll need something like Sosumi. ``` ❯ curl -I -H "Accept: text/markdown" developer.apple.com/documentation/… Content-Type: text/html; charset=utf-8 ```

@bcherny SWEET! This should just work with Sosumi then, yeah? @mattt

In the next version of Claude Code, Claude’s WebFetch tool automatically adds Accept: “text/markdown, *” to requests which helps docs sites provide token-efficient docs

@adityadaniel Yes, that's correct. This is something we'd like to support, and is actively being worked on now. Follow this issue to track our progress: github.com/mattt/AnyLangu…

@mattt Hi Matt, thank you for your work on this project. I’m currently checking it and curious if structured generation with Generable macros using OpenAI or Anthropic model will be supported in streaming call? As far as I know the current implementation only support String type.

Thanks to everyone who's checked out AnyLanguageModel so far! I just cut a new 0.3.0 release with a Gemini adapter that supports Google search grounding, code evaluation, and more: #google-gemini" target="_blank" rel="nofollow noopener">github.com/mattt/AnyLangu… Next up — Documenting best practices for managing API credentials in your app. The current README shows usage with environment variables, but that only works server-side. There are a few good options (and one very bad option), and it'd be helpful to write those up.

@elmomertens Just added in the latest release! x.com/mattt/status/1…

@mattt I haven't checked this out, but official FoundationModel API and other similar implementation (SwiftAI) didn't support image input, and I assume this doesn't as well?