David Sobrín

¡Tenemos nuevo doctor en el grupo! 🥳 Ayer nuestro compañero @miggsant defendió su tesis titulada "Generación de Comportamientos en Robots Autónomos mediante una Arquitectura Cognitiva Híbrida". @unileon #Unileon #robotics #ROS

♾️ Visual Learning 🧑‍🏫 If this is how I learned math I am certain I would have been far more engaged. Now that I have the letters connected to the line I’m drawing, I’m trying to sort out default orientation. #XR #AR #MixedReality #Quest3 #Math #Quaternion #Prototype

林冠を衝突を避けながら飛行し、密林をマッピングする自律飛行ドローン youtu.be/9NZvVPvUrPo #drone #SLAM #RGBDsensor #autonomous #mapping #navigation #DigiForest

Finally I get a Steam Deck to run #ROS2 and maybe play some games 😏

Just a simple chatbot based on #LLM for #ROS2. It is controlled by a YASMIN state machine that uses #llamacpp + #whispercpp + #VITS.

My repos: - YASMIN: github.com/uleroboticsgro… - llama_ros (llama.cpp from @ggerganov for #ROS2): github.com/mgonzs13/llama… - whisper_ros (whisper.cpp from @ggerganov for #ROS2): github.com/mgonzs13/whisp… - audio_common (my audio pkg for #ROS2 with the tts lib): github.com/mgonzs13/audio…

Engineering a small transformer

Introducing BioCLIP: A Vision Foundation Model for the Tree of Life imageomics.github.io/bioclip/ A foundation model that strongly generalizes on the tree of life (2M+ species), outperforming OpenAI CLIP by 18% in zero-shot classification, and supports open-ended classification over almost the entire tree of life What's the secrete ingredients? > Data: we curate and release TreeOfLife-10M, the largest and most diverse ML-ready dataset of organism images to date. It contains 10.4M images for over 450K taxa, sourced from iNaturalist, BIOSCAN, and Encyclopedia of Life. > Modeling: we creatively repurposes CLIP's multimodal contrastive learning objective for hierarchical image classification. The autoregressive language model naturally encodes the hierarchy of the tree of life taxonomy, which in turn bakes the hierarchical representation into the vision transformer encoder. Key results > Strong zero/few-shot classification for animals/plants/fungi, including rare species, outperforming CLIP by avg 16-18% absolute. > T-sne visualization shows that BioCLIP's vision encoder has captued the fine-grained hierarchical structure of the tree of life > BioCLIP is a kind of universal classifier for the tree of life. Just give it an organism image and it will likely find the correct species (among top 5)! But use it with caution; it's not perfect yet.. Final remarks > AI for Science is really hard but extremely rewarding! It took us a ton of time (1+ year) and frustration trying to find a plausible way to integrate the tree of life taxonomy into foundation model training. But when the "Eureka!" moment came and the idea hit us (by the great @weilunchao) that CLIP's multimodal contrastive learning objective can be repurposed for that, everything just follows naturally. It was truly a moment of joy and excitement! > BioCLIP is our first attempt at foundation models for biology, but it certainly won't be the last! There's so much more to do at the intersection of one of the oldest scientific disciplines and the young but thriving field of AI. Biological intelligence is the foundation for artificial intelligence, and artificial intelligence will in turn become the most important tool for us to unraval the mysteries of biological intelligence. We are hiring postdocs and PhDs in the NSF @imageomics institute to explore this exciting field! Drop us an email. also happy to chat about it at #NeurIPS2023 with any of Tanya, @weilunchao, or me. - paper: arxiv.org/abs/2311.18803 - project: imageomics.github.io/bioclip/ - demo: huggingface.co/spaces/imageom… - model: huggingface.co/imageomics/bio… - data (TreeOfLife-10M): to be released on Hugging Face soon joint work with the amazing @imageomics team: @samstevens6860 Lisa Wu, Matt Thompson, Elizabeth Campolongo @luke_ch_song @Carlyn2015 @donglixp @dahdulw Chuck Stewart, Tanya Berger-Wolf @weilunchao @ysu_nlp

El Grupo de Robótica de @unileon en @StartupOle. Cada año se superan!!! #StartupOle #CISIS #HAIS #SOCO #Salamanca

It's alive

A new robot has arrived at the lab, a Mini Pupper 2 from @LeggedRobot

Hoy @amigueldiez ha presentado en El Filandón Hacker la auditoría de seguridad que le ha hecho a nuestro perrito Tuercas 🤖👏

Para los que me estáis siguiendo en esta cuenta a raíz de la novela

Super agile and balanced, Direct Drive's Diablo is the world first wheeled-leg transformable robot powered by 6 direct-drive motors. An open development platform for custom controls & DIY [read more: diablo.directdrive.com]

Nuestro equipo necesitan apoyo para ganar el premio a mejor vídeo, darle a like y comentar! Our Team need support to win the best video award, like and comment! youtu.be/mFw9BvHkAJ0 @EIF_URJC @RoboticaSw_URJC @urjc

Integrantes de #Gentlebots, que están compitiendo estos días en Burdeos Francia

Algunos de nuestros compañeros están esta semana en #RoboCup2023 junto a los chicos de las URJC. Mucha suerte chicos!!!🤖

Day 2 at the @RoboCup2023 #competition! 🏆 Today, the teams are patiently working on their codes to make #TIAGoRobot perform the desired task.🧑‍💻 We are happy to be here to support the teams. 🤝 #robocup2023 #Robotics #research #TechnologyNews #Science

Our teammate has arrived at the @RoboCup2023 competition. ✈️ It's so exciting to see so many of our TIAGo #robots in action - a total of seven and one TIAGo Base! 🤖 We are ready to support the teams and watch the best one win! 🏆 #RoboCup2023 #TIAGoRobot #Competition #technology