gufengc

@chrisbolas @tryParallax We already support fp8, mxfp4, int4 accually. You can checkout all models we support here github.com/GradientHQ/par…

@tryParallax are you only supporting fp16 for the foreseeable future? (As far as I could tell that is what all the supported models were available)

Build your own AI lab -- Who are the winners? x.com/i/spaces/1OdKr…

@VoidAsuka amazing👏

just built a local AI waifu on my two macbooks by using the oss parallax inference library!!! not super smooth yet but parallax is still the easiest way to run llms locally on top of mlx - and no bigco can steal my waifu. still need folks to help her see/hear/draw since mlx has no legit wrapper yet. i’m running a campaign giving away mac minis + dgx spark. please please share your localhost ai model setup by using parallax (you don't need a gpu to try self-hosting you can just start with an extra macbook you borrowed from your friend like i did) or any fun app built on top of yourself host model to link below. come build sovereign intelligence with me 🫶