Alexandre Mendes

From one scene to a thousand variations - in minutes. Building diverse datasets for computer vision is no longer a bottleneck. Train and test faster. Control what matters. youtube.com/watch?v=_HA4J4…

First up at #UpSurge. Meet @bifrost_ai who are empowering today's creators with the computer vision tools to unleash innovation & capabilities that were previously unimaginable. Check out their awesome #GenerativeAI video below to see it in action! 👇

@iBrews Yes it is. Animation retargeting and morph targets being buzz words that might help getting more context on how 👍

@_AllexMendes do you know if it's possible to do something with this but with a huge variety of randomly generated metahumans?

The MetaHuman Sample dataset is publicly available over at Kaggle, includes all rendering methods and some base metadata. Also includes timed speech and audio associated. kaggle.com/allexmendes/me… #SyntheticData #computervision #MetaHuman #UE4

@Fishylein Both FACS dataset and this are basically making use of existent MetaHumans morph targets, the difference is that in this case is being live tracked by Openpose face module while FACS were preset poses. I don't really have a shareable script for this. Hope it helps

@_AllexMendes Hey, apparently I'm working on the same thing with a similar approach. I found your FACS set on kaggle, and was wondering if you were using a script to export those and if so, if you could provide it so that i could replicate it with different lighting

Face tracking and some FACS being applied just with a simple RGB webcam. Improving the "shakiness" from 3d pose estimation soon. #UE4 #UnrealEngine #MetaHuman #AR

@lliang2003 No, not public yet.

@_AllexMendes is it open source?

The good result. Just needed some more smoothing around the eyes and lips. #zivafaces

Think I've done something wrong @ZivaDynamics 🗿

Something wrong #2

You can even filter triangle count and etc... docs.unrealengine.com/4.26/en-US/Bas…

Today I learned about unreal advanced search syntax… In this case, search under MetaHumans directory filtering assets that have"body" and "f" and not "preview" in their name. These can also be saved as collections for quick use #UE4 #ue4tips

@tharkban I've added that as a description to the dataset. I'm aware, to an extent, and plan to fix it on a next version. Although pose itself is correct, camera to hand perspective doesn't follow asl pose standards.

Synthetic dataset for ASL Alphabet hands poses. 1K images per letter, diversity, randomization and per-finger segmentation for easier understanding. kaggle.com/allexmendes/as… #SyntheticData #ASL #UE4 #computervision

Published a dataset sample of multiple realistic synthetic humans performing random FACS expressions. Feel free to explore it. kaggle.com/allexmendes/sy… #SyntheticData #FACS #metahumans

Web streaming UE's scene viewport, editor, PIE, and standalone. So far possible applications I've thought of are remote collaboration, teaching and eventually other cloud-streamed apps. #UE4 #UnrealEngine

Published a dataset sample of highly realistic simulated humans with pixel-perfect segmentation and metadata including gaze direction. Feel free to explore it. kaggle.com/allexmendes/sy… #SyntheticData #ComputerVision #UE4 #metahumans

Can AI make graphics look realistic ? 🚗 👇Proud to announce a new work with Stephan Richter and Vladlen Koltun. I worked on this in my internship at Intel but majority of credit is to Stephan who persisted to make it work and work robustly. full video: youtu.be/P1IcaBn3ej0

Sample of falling things dataset mixing highly realistic fruits and YCB models. Dataset sample at : kaggle.com/allexmendes/sy… #SyntheticData

Improved the webcam face tracker. Now with a more stable head pose. #UE4 #UnrealEngine #MetaHuman #AR

Endless puzzle...