Mobius Labs

415 posts

Mobius Labs banner
Mobius Labs

Mobius Labs

@Mobius_Labs

Multimodal AI for the world's scale. Proponents of Open Source and Open Intelligence. https://t.co/1nC6r8hOrE for some of our recent work.

Berlin, Germany Katılım Nisan 2018
211 Takip Edilen3.3K Takipçiler
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
hmm isn't it obvious this would work better than QAT? I’ve been doing this already for HQQ+, the DeepSeek re-distill work, and FP4 weight quant quality recovery. More comments below 🧵
NVIDIA AI Developer@NVIDIAAIDev

We just launched an ultra-efficient NVFP4 precision version of Nemotron 3 Nano that delivers up to 4x higher throughput on Blackwell B200. Using our new Quantization Aware Distillation method, the NVFP4 version achieves up to 99.4% accuracy of BF16. Nemotron 3 Nano NVFP4: nvda.ws/4t63z9y Tech Report: nvda.ws/4bj3pp0

English
6
4
20
2.4K
Mobius Labs
Mobius Labs@Mobius_Labs·
If you’re at @EurIPSConf this week and looking for your next ML role, ping us. Few of us from @Dropbox including @mobicham @appughar will be there Happy to chat about roles in multimodal, search, and video-AI.
Mobius Labs@Mobius_Labs

Looking for people with experience in : Building and scaling multimodal ML systems, Retrieval, ranking, and creative search problems, Turning prototypes into polished products 🌍 Remote (Germany or Denmark) Apply here: jobs.dropbox.com/listing/7384405 (Please use the link, not DMs!)

English
0
3
4
616
Mobius Labs
Mobius Labs@Mobius_Labs·
Looking for people with experience in : Building and scaling multimodal ML systems, Retrieval, ranking, and creative search problems, Turning prototypes into polished products 🌍 Remote (Germany or Denmark) Apply here: jobs.dropbox.com/listing/7384405 (Please use the link, not DMs!)
English
0
0
0
751
Mobius Labs
Mobius Labs@Mobius_Labs·
We are looking for a Machine Learning Engineer (IC3) to join our Multimedia AI team at Dropbox! You’ll work on the ML behind Dropbox Dash, building real multimodal search experiences across images, video, and text — and ship things that millions of people actually use.
English
1
0
0
238
Mobius Labs retweetledi
Drew Houston
Drew Houston@drewhouston·
And for my fellow nerds: with Dash, we're obsessed with depth of context, not just breadth. Dash isn't just calling APIs and doing naive keyword search. We build a full semantic index of all your content that is natively multimodal: not just documents but images, videos, everything. This is the only way to build true understanding and close the context gap to make AI actually useful at work.
Drew Houston@drewhouston

Our industry is spending trillions on AI models that can explain quantum physics but can't find your Q2 board deck. We're fixing this with Dropbox Dash, an AI assistant and search engine that knows about you, your work, and your company, and is deeply connected to all of your work apps.

English
2
3
25
36.7K
Mobius Labs retweetledi
Josh Clemm
Josh Clemm@joshclemm·
The best AI apps need the right context and @Dropbox Dash is built to provide it. Thrilled to welcome the incredible tech and talent from @Mobius_Labs to the team. Multimodal AI will make the Dash context platform even stronger 💪
Mobius Labs@Mobius_Labs

@Dropbox is acquiring our IP, and the Mobius core tech team is joining them. A huge milestone for us! dropbox.tech/machine-learni…

English
1
3
11
26.4K
Mobius Labs
Mobius Labs@Mobius_Labs·
@Dropbox Keep supporting us, keep an eye on what's next, give Dropbox Dash a spin… or come join us to take this search + AI revolution to the next level. dash.dropbox.com
English
0
0
0
106
Mobius Labs
Mobius Labs@Mobius_Labs·
@Dropbox Now, we get to take that spirit to @Dropbox scale — building GenAI-native apps that reimagine how people work.
English
1
0
0
141
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
Looking forward to the @GPU_MODE hackathon later this Friday! Your boi will be there and happy to assist 🫡
mobicham tweet media
English
1
1
24
1.3K
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
Kinda disappointed by Qwen3-VL's decoder perf with vLLM so far. Can squeeze better perf via GemLite instead of DeepGEMM but the numbers still seem suspiciously low
mobicham tweet media
English
0
1
4
593
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
It's happening: MXFP on sm_120 using pure Triton via GemLite, reaching very competitive performance 🫡 Shoutout to Hyunsung Lee (@HyunsungLe78860) for the hard work in bringing MXFP support to sm_120!
mobicham tweet media
English
2
10
56
3.3K
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
Rewrote gpt-oss's experts forward pass (bfloat16 weights) in transformers to only use active experts + simple gemv MoE Triton kernel: 36 tokens/sec -> 165 tokens/sec (20B on the RTX6000 Pro) MXFP4 weights next, decoding should run faster 👀
English
3
10
78
3.3K
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
Been playing with low-bit training this morning (3-bit, 2-bit, 1.58bit). Simple key trick to make it work: dumpen the gradients in the backward pass 🫡 gist.github.com/mobicham/b5c8f…
English
2
3
32
1.3K
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
Simple and fast MXFP8 activation quant kernel: ✓ Padding-aware for arbitrary seq lens ✓ SM-aware unrolling to improve occupancy (large batches) ✓ ~10% faster than torch.compile in end-to-end inference
mobicham tweet media
English
1
11
93
4.7K
Mobius Labs retweetledi
mobicham
mobicham@mobicham·
Here's how to write a fast MXFP4/NVFP4 dequant GEMV kernel for batch-size=1: -Use a mapping + tl.gather to map the quant matrix block indices into double the fp4 range -Load the scales as e8m0.view(uint8) and use tl.exp2 to convert ~13% faster than SPLIT-K with tl dot_scaled
mobicham tweet media
English
0
2
27
1.6K