Nevasini
118 posts

Nevasini
@Nevasini1
MLE @ ObinAI | Ex- Microsoft, Adobe and Intel | UCSD Grad
NYC Katılım Nisan 2021
2.2K Takip Edilen148 Takipçiler

Been digging through STERA-10M all morning. some notes:
10M FPV samples for training world models, just released by @fpv_labs on Hugging Face.
a few reasons I think this matters for embodied AI / spatial intelligence 🧵
huggingface.co/datasets/fpvla…
English
Nevasini retweetledi

📝 Introducing "𝐀𝐥𝐥 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬 𝐌𝐚𝐭𝐭𝐞𝐫: 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐧𝐠 𝐋𝐌𝐌𝐬 𝐨𝐧 𝐂𝐮𝐥𝐭𝐮𝐫𝐚𝐥𝐥𝐲 𝐃𝐢𝐯𝐞𝐫𝐬𝐞 100 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬 (𝐀𝐋𝐌-𝐁𝐞𝐧𝐜𝐡)"
➡️ 𝐃𝐢𝐯𝐞𝐫𝐬𝐞 𝐌𝐮𝐥𝐭𝐢𝐥𝐢𝐧𝐠𝐮𝐚𝐥 𝐁𝐞𝐧𝐜𝐡𝐦𝐚𝐫𝐤: A culturally diverse multilingual and multimodal VQA benchmark covering 100 languages with 22.7K question-answers.
➡️ 𝐂𝐨𝐦𝐩𝐫𝐞𝐡𝐞𝐧𝐬𝐢𝐯𝐞 𝐃𝐨𝐦𝐚𝐢𝐧 𝐂𝐨𝐯𝐞𝐫𝐚𝐠𝐞: ALM-bench encompasses 19 generic and culture-specific domains for each language, enriched with four diverse question types.
➡️ 𝐄𝐱𝐩𝐞𝐫𝐭-𝐕𝐞𝐫𝐢𝐟𝐢𝐞𝐝 𝐀𝐧𝐧𝐨𝐭𝐚𝐭𝐢𝐨𝐧𝐬: With over 800 hours of human annotations, ALM-Bench is meticulously curated and verified with native-language experts to assess the next generation of massively multilingual multimodal models in a standardized way, pushing the boundaries of LMMs towards better cultural understanding and inclusivity.
🔹 "𝐀𝐥𝐥 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬 𝐌𝐚𝐭𝐭𝐞𝐫: 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐧𝐠 𝐋𝐌𝐌𝐬 𝐨𝐧 𝐂𝐮𝐥𝐭𝐮𝐫𝐚𝐥𝐥𝐲 𝐃𝐢𝐯𝐞𝐫𝐬𝐞 100 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬 (𝐀𝐋𝐌-𝐁𝐞𝐧𝐜𝐡)"
🔹 In collaboration with @MBZUAI, @UCF, @AaltoUniversity, @our_ANU, and @liu_universitet
📝 Paper: arxiv.org/pdf/2411.16508
🔗 Project: mbzuai-oryx.github.io/ALM-Bench/
🤗 Dataset: huggingface.co/datasets/MBZUA…
💻 Code: github.com/mbzuai-oryx/AL…
🙏 Thanks to the entire core team and all the volunteers.
#ArtificialIntelligence #GenAI #research

English

@vegfriedmomos @aditeyabaral01 so they are friends who are not friending?🤭
English





