DeepMotion

After 𝘁𝘄𝗼 𝗺𝗼𝗻𝘁𝗵𝘀 of hard work (not full-time) I finished this first animation for the partnership with Dell Technologies and my company Third Move Studios. Please watch in 4k (link in the comments). 🔋 This animation was created on a Dell Precision 3680 workstation powered by a NVIDIA RTX™ 6000 Ada Generation GPU and NVIDIA Studio driver. 🔥 And I need to say, this Dell workstation is a beast! Incredibly fast and robust, it runs EVERYTHING! 💻 Now let's talk about the tech part (because I know you like it 😊) It's fully 3D, but some very cool AI were used in this workflow: • ElevenLabs Text-to-Speech for generating voices and also sound effects. I've generated custom voices based on what I wanted like 𝙮𝙤𝙪𝙣𝙜 𝙢𝙖𝙣 𝙛𝙧𝙤𝙢 𝙩𝙝𝙚 𝙨𝙩𝙧𝙚𝙚𝙩𝙨 𝙩𝙝𝙖𝙩 𝙩𝙖𝙡𝙠 𝙨𝙡𝙖𝙣𝙜𝙨 for the dudes in the end. Custom voice for the teacher as well. • NVIDIA Omniverse Audio2Face for facial animation, playing with keyframes and changing emotions as well. • For AI motion capture, I've tested DeepMotion and it turns well with their motion smoothing in Professional subscription (AI filter that helps to remove jitter and produce smoother animations). • Reblium for creating all the characters. Their AI tools were essential to generate different races and genders. • Beeble SwitchLight for PBR map extraction and relighting the Dell workstation and integrating it into UE5 scene. • AI powered rotobrush in Adobe After Effects. • Maxon Cinema 4D Lite, Premiere Pro and Photoshop. • Rendered in Unreal Engine 5.4 with Lumen and raytraced shadows. • Also, I used the amazing Cinematic Lens Flares from Dylan Browne + 3D tracked Optical Flares from Video Copilot (Andrew Kramer) on top of the footage to achieve a better look with the LUT I've chosen in post-production. • EasyRain from William Faucher. • More assets from Fab. Thank you so much Cindy Olivo and Logan Lawler! #Dell #DellPrecision #RTX6000 #NVIDIA #RTXOn #DellPartner #NVIDIAStudioAmbassador #UE5 #UnrealEngine5 #FAB #AI #3D #CreatedwithFab 80 Level ArtStation

Pretty impressed with DeepMotion 's avatar 3D models. Any recommendations for tools to recreate yourself in a more realistic mode (just face talking to camera)?

This R&D phase with DreamLab has focused on creating the most empathic environment for children. We’ve been exploring how to apply authentic human movements and facial expressions to our stylized characters, who guide children through their experience in our interactive emotional health tool. Drawing on ideas from our co-creation sessions with children and professionals, we began testing at dock10's virtual production and performance capture studio in MediaCityUK, where actor Sophie Stewart helped us trial movements for a cute new character, suggested by the children to boost engagement. With those insights, we tweaked our script ready for our final recordings. Our aim is to provide an engaging, child-friendly experience that uses AI tools to streamline what might otherwise be a costly animation process. This approach will allow us to make updates more efficiently, keeping the tool accessible and flexible while helping children explore their feelings and develop strategies for life. We recorded the final performances at the DreamLab, using Rokoko headsets and Epic Games' Metahuman Animiator on iPhones to capture facial movements. And, after testing several options, settled on DeepMotion to process body movements and for the app's metahumans. This phase has not been without its challenges, and reminding ourselves that R&D is all about trial and error has been key. A huge thank you to our programmer, Luke at Sigtrap, whose dedication and problem-solving skills have been the backbone of this project. A big thanks to Arpana Nandakumar, David Afolabi and Christian G H Frost for helping us explore the AI motion capture options and supporting our final recordings. And to Ryan Parker for stepping in at the last minute to help us overcome numerous technical challenges and get things over the line! #MotionCapture #InnovationAccelerators #MentalHealthTech #EdTech #ChildMentalHealth #Gamification #TechForGood DreamLab MediaCity Immersive Technologies Innovation Hub Greater Manchester Business Board (LEP) Greater Manchester Combined Authority