I've just realized that this comment was worded very poorly - @exolabs is the pioneer in distributed MLX, I didn't wanted to shed any bad light - actually, I'm a huge fan of it and without the amazing work from @alexocheema it would have not been possible for @LocalAI_API to support MLX distributed! Please keep up the great work!!
Indeed, our backend is based from @exolabs implemenation and we call that out clearly in the docs, in our readme and in the code (thank you!).
What I wanted just to show is that we ( @LocalAI_API ) are trying to be more Apple friendly and feedback from the MLX community would be really appreciated!
Ettore Di Giacinto@mudler_it
@ivanfioravanti I'll do a shameless plug and tell to try @LocalAI_API ? Opencode and Claude code works well here, but I couldn't test mlx distributed backend ( I have only a small Mac mini, so I could just validate it).
English
