lolendo

@iskruna0 I will buy 500

@0xIlyy Self Employment.

What is the fastest way to get a job in AI?

@0xIlyy Status update???

Sweating restoring the prod DB. the next few minutes will decide if i get fired or not.

@0xIlyy Thats why your parsing never works

I will never write regex myself. This is LLM slave work.

@0xIlyy Kubernetes is easy though :c

AI companies worth trillions cannot figure out infra meanwhile you're thinking of implementing kubernetes on your personal website?

@NMHonX @giladerdan1 @amorinhaporto @_VanessaFrazier Welcome to yappingville, funded by mossad.

@giladerdan1 @amorinhaporto @_VanessaFrazier The UN is useless when they aren’t evil

This evening, I sent an urgent letter to the president of the Security Council, @_VanessaFrazier. I called on the Council to hold an emergency meeting and demanded that they condemn Iran’s attack on Israel and designate the Iranian Revolutionary Guard Corps as a terror organization. The Iranian attack is a serious threat to global peace and security and I expect the Council to use every means to take concrete action against Iran.

@EshalomX @giladerdan1 @_VanessaFrazier remind me, who has a 98% civilian casuality report? Oh right. Israel.

@d0rc @rohanpaul_ai Wouldnt we average the total here?

@Sureiwill2 @rohanpaul_ai

Apple's 3B LLM Outperforms GPT-4 🤯 📌 They also found that the performance of ReaLM and GPT-4 are very similar for the unseen domain. 📌 ReALM significantly improves how conversational assistants like Siri or Alexa can understand the way humans naturally talk. Imagine you're looking at a list of restaurants on your smartphone and you say "direct me to the one on Main Street" - ReALM is able to understand which restaurant you're referring to, even though you didn't specify the exact name. 📌 It achieves this by cleverly converting the visual layout of what's on your screen into a text format that a powerful language-understanding AI model can reason about. This allows ReALM to resolve ambiguous references (like "it", "that one", "the second item") in a way similar to how humans intuitively grasp context. 📌 ReALM outperformed prior approaches on this task and nearly matched GPT-4 model while being much more efficient, making it practical to implement on devices like smartphones. 📌 So now AI assistants can converse more naturally, enabling interactions like "book a table at the Italian place I just looked at" without having to tediously spell everything out.

@lucasteske Thats to be expected, as per the architecture of the GPU. You should try 32 if you get the chance.

@Sureiwill2 Quants. I think fp16 will still run the same. P40 is horrible with FP16

Just tried a 13B LLM Model (WizardLM) in a Tesla P40 a friend borrowed me. So far, 3 Tokens / second. Will try other models see how it performs.

@reach_vb credit to u/Dazzling_Ad1507

UPDATE: Gemma 1.1 7B & 2B - Instruction Tuned! ✨ > substantial gains in quality, coding capabilities, factuality, and instruction following. > better multi-turn conversation quality. huggingface.co/google/gemma-1…

@lucasteske whats nowadays mean, like quants or did some software or driver change occur?

@Sureiwill2 Its running faster nowadays. I was running the fp16 model.

@d0rc @rohanpaul_ai You sure suck at math

@rohanpaul_ai Even more news: their 80M is better then their 3B😂

@_borombo LLM Farm apps.apple.com/us/app/llm-far…. Private LLM apps.apple.com/us/app/private…. Those are the two ive personally tried, and then theres projects like llm.mlc.ai which are also pretty cool.

@Sureiwill2 Haven't found any you can use offline, so if you have some links, would love to check this out!

Introducing Evai - The first 100% Private Chabot It's an iOS app that runs LLM locally on your device. This means you can use a chatbot offline, without sending any data to the cloud or unknown companies. It's like having ChatGPT directly on your device. Give it a try ⬇️

@Christel_OCC @myaitutor Everytime another open source AI GUI is dropped with seemingly no improvement I lose braincells.

Did you know you can access all available LLM models in one platform with @myaitutor ? 😮 With no limits!

@ianzelbo @opera How fast does it run, and what model are you using?

Testing out @opera's new local LLM support on my new M3 MacBook Air👀#partner

@Icannotreid You can run up to 46B models at 4bit quants completely offloaded with it (eg. mixtral), and probably up to 20B models in FP16. So yes, it is very good for consumer grade inference.

Is a P40 gpu good for running text generation LLM's?

@Google just doing google things...

@jveld_Biology They werent.

@MarleyK20 You're quite possibility the most rasict person I have come across...