Fuseman

A first prototype of @unity3d Render Streaming working with @ImmersiveWebW3C A-Frame on Oculus Quest! Tracking data is sent from WebXR to the Editor and Rendering is done in Unity (on PC or in the Cloud) and streamed back to the Browser.

A Tesla engineer told me that Tesla has invested a lot of engineering resources in CyberCab and has already achieved almost everything. But for some reason, no relevant information was disclosed at the launch event, giving people the impression that it’s a concept car.

@SVVRLIVE @JonVirtual He will be deeply missed

With a heavy heart we regret to inform you that our beloved co-organizer and friend Jon Oakes has passed away. He was kind and generous to every single person who crossed his path and he always wore a smile. Our hearts are broken, and our thoughts are with his family.

To close out 2023, here are 10 of the most interesting AI research advancements we shared on our feed this year —  and where you can find more details on the work. 1️⃣ Segment Anything (SAM) A step toward the first foundation model for image segmentation. Details: bit.ly/3tyeJKu 2️⃣ DINOv2 The first method for training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards. Details: bit.ly/3TGTEIb 3️⃣ Llama 2 The next generation of our open source large language model, available for free for research and commercial use. Details: bit.ly/3RY66C6 4️⃣ Emu Video & Emu Edit Generative AI research for high quality, diffusion-based text-to-video generation & controlled image editing with text instructions. Details: bit.ly/3RZVZwU 5️⃣ I-JEPA Self-supervised computer vision that learns to understand the world by predicting it. The first model based on a component of @ylecun's vision to make AI systems learn and reason like animals and humans. Details: bit.ly/3TA9oNk 6️⃣ Audiobox Our new foundation research model for audio generation. Details: bit.ly/47ib6pQ 7️⃣ Brain decoding - toward real-time reconstruction of visual perception Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution. Details: bit.ly/3vpgDNR 8️⃣ Open Catalyst demo A service that allows researchers to accelerate work in material sciences by enabling them to simulate the reactivity of catalyst materials faster than existing computational methods. Details: bit.ly/3vphiij 9️⃣ Seamless Communication A new family of AI translation models that preserve expression and deliver near-real time streaming translations. Details: bit.ly/3toBDE8 🔟 ImageBind The first AI model capable of binding data from six modalities at once. A breakthrough that brings machines one step closer to the human ability to bind together information from many different senses. Details: bit.ly/3NLUaBc

Write-first culture is a game changer. I highly recommend learning about @JeffBezos’ management strategy around six pagers/memos — it really works for important decisions twitter.com/BrianJJi/statu…

I genuinely think tech should move out of SF. It was a huge blunder. Elon had to blow 40B to try to offset the damage from just one captured company. But it’s going to keep happening. Just drive an hour south, jfc. Sama should start NextAI in San Jose.

It’s interesting that it only takes 4 mo now to train an LLM to GPT 3.5/Llama 2 from scratch. Prior to Jan this year, nobody had practically replicated GPT-3 still. It doesn’t seem like the lead of GPT-4 will last too much longer.

Announcing Grok! Grok is an AI modeled after the Hitchhiker’s Guide to the Galaxy, so intended to answer almost anything and, far harder, even suggest what questions to ask! Grok is designed to answer questions with a bit of wit and has a rebellious streak, so please don’t use it if you hate humor! A unique and fundamental advantage of Grok is that it has real-time knowledge of the world via the 𝕏 platform. It will also answer spicy questions that are rejected by most other AI systems. Grok is still a very early beta product – the best we could do with 2 months of training – so expect it to improve rapidly with each passing week with your help. Thank you, the xAI Team x.ai

I distilled my 4 years of marketing lessons into minimalistic visuals. 1. Sell Benefits. Not features.

@chheplo So much opportunity to build revolutionary applications. Unbelievably early

Got out of the Bay Area/California first time after ChatGPT and GenAI explosion, met real people, and, and, no one really care about it, think about it everyday, or at all. Either we are in a bubble or time to build more applications for everyday consumers and non-tech folks.

I've turned the llama.cpp implementation of LLaVA (multimodal text and image AI) into a really simple server. I've been running it on my M1 Macbook! Get it here: github.com/trzy/llava-cpp…

We believe that AI models benefit from an open approach, both in terms of innovation and safety. Releasing models like Code Llama means the entire community can evaluate their capabilities, identify issues & fix vulnerabilities. github.com/facebookresear…

🦙 Llama 2 and Code Llama models are now available in the Vertex AI Model Garden — more details from @GoogleCloudTech ⬇️

I know it's been said many times but using AI tools now really is like using Google back in the early 2000s Huge asymmetrical returns to take advantage of, 100% worth taking time to update your setup and workflows to better wield such tools, future self will thank you

Whooaaa what happened to @furioos ?! it was literally my first Unreal Engine pixel streaming experience :(

I wrote a bit of a guide to ChatGPT’s Code Interpreter, which I have found to be the most useful and powerful mode of AI. It is, like every product made by OpenAI so far, terribly named. It is less a tool for coders and more a coder who works for you. oneusefulthing.org/p/what-ai-can-…

ChatGPT is releasing its most powerful tool to all paid users - The Code Interpreter! It can do everything, from creating maps to editing videos to making color palettes 🤯 Here are some of the craziest things it is capable of👇

@OpenAI Code Interpreter is pretty nutty in that it is also able to debug itself in real time, which has been my biggest issue with tools like StarCoder

@AndreElijah Is it worth learning if you are excited as a hobby? Absolutely! Is it worth diving head first as a career? Agreed, I'd recommend waiting a few years

I'd recommend new people NOT get into XR until the market is more stable and they don't risk going broke entering the space.

The latest @lexfridman episode with @realGeorgeHotz has a brilliant take away about onboarding users into VR. He bought a quest 2 and said the first thing he saw was a pop up - a meta login prompt We’re leaving folks behind by not showing them an incredible world out of the box