
Local models are actually pretty good now.
No, they aren't a reliable source of facts and the baked in knowledge is pretty rough. Done use them for what they "know
Use them for what they can "do"!
They are great for using tools, managing workflows, producing structured outputs, condensing and summarizing text, classification and so much more.
If you install a local model and ask it to recite some facts or tell you about some historical concept it will likely fail. Give it some tools, some memory, and a harness though and WOW
Boston, MA 🇺🇸 English