Live Link Face

Name: Live Link Face
Rating: 3.6 (109 reviews)
Author: Unreal Engine

For Unreal Engine

Free

109 Ratings
Ages

4+
Years
Category

Graphics & Design
Developer

Unreal Engine
Language

EN
+ 3 More
Size

122.3
MB

Live Link Face for effortless facial animation in Unreal Engine—capture performances for use in Unreal Engine from your iPhone or iPad. Capture facial performances for MetaHuman Animator: - Live Link Face supports both real-time and processed animation. - MetaHuman Animator uses Live Link Face to capture performances, then applies its own processing to create high-fidelity facial animation for MetaHumans. - The Live Link Face app captures raw video and depth data, which can be transmitted directly from your device into Unreal Engine for use with the MetaHuman plugin. - Facial animation created with MetaHuman Animator can be applied to any MetaHuman character in just a few clicks. - This workflow requires an iPhone (12 or above) and a desktop PC running Windows 10/11. Real-time animation for MetaHumans: - The Live Link Face app generates animation to drive a MetaHuman Character in real time. - Animation data is streamed to Unreal Engine over a network using the MetaHuman Live Link Plugin. - This workflow requires an iPhone (12 or above) and a desktop PC running Windows 10/11. Real-time animation for non-MetaHuman characters: - Stream out ARKit animation data live to an Unreal Engine instance via Live Link over a network. - Visualize facial expressions in real time with live rendering in Unreal Engine. - Drive a 3D preview mesh, optionally overlaid over the video reference on the phone. - Record the raw ARKit animation data and front-facing video reference footage. - Tune the capture data to the individual performer and improve facial animation quality with rest pose calibration. Timecode support for multi-device synchronization: - Select from the system clock, an NTP server, or use a Tentacle Sync device to connect with a master clock on stage. - Video reference is frame accurate with embedded timecode for editorial. Control Live Link Face remotely with OSC or via the MetaHuman Plugin for Unreal Engine: - Trigger recording remotely so actors can focus on their performances. - Capture slate names and take numbers consistently. - Extract data for processing and storage. Browse and manage the library of captured takes: - Delete takes within Live Link Face, share via AirDrop. - Transfer directly over network when using MetaHuman Animator. - Review captured footage on-device.

Ratings & Reviews

3.6

out of 5

109 Ratings

Outstanding
07/12/2021

BathroomTiles
Incredibly useful app for animation! Just one thing I think needs to be in the next update. A way to set facial readings to neutral while my face is in the neutral resting position. Live link thinks my mouth is slightly open when it is in fact completely closed. The work around is not terribly grueling so it’s not a show stopper. Besides that, this app is an absolute must for both new and experienced character animators!
Outstanding
07/12/2021

BathroomTiles

Incredibly useful app for animation! Just one thing I think needs to be in the next update. A way to set facial readings to neutral while my face is in the neutral resting position. Live link thinks my mouth is slightly open when it is in fact completely closed. The work around is not terribly grueling so it’s not a show stopper. Besides that, this app is an absolute must for both new and experienced character animators!
Works well enough
May 21

Probablycarestoomuchaboutthis
I wish I could say this was really fantastic, but honestly it’s just average at best. Maybe it’s just me, but I can move my eyebrows independently of one another - I can lift one up, and scrunch the other up or leave it totally relaxed and it’s very frustrating to see how poorly handled eyebrow tracking is in general. Especially when eyebrows give so much emotion. I’m running this on an iPhone 15 Pro Max and I still can’t get the darn thing to just track my eyebrows. Instead it tracks only one eyebrow or weirdly mixes the motion of each eyebrow into one half-baked combo. Mostly it just makes my whole forehead look dead - like, I can’t even begin to tell you how important eyebrow motion is to conveying the emotions and thoughts of a character. Heck, it might be more important than every other facial feature combined. I’m ranting. I really wanted to love this - I really wanted to feel like it’s a game changer. But, it’s just kinda average. It’s largest selling point is that it’s integrated into Unreal and you can transfer simple mocap and reference footage from via the live link. I just wish the actual tracking was better.
Works well enough
May 21

Probablycarestoomuchaboutthis

I wish I could say this was really fantastic, but honestly it’s just average at best. Maybe it’s just me, but I can move my eyebrows independently of one another - I can lift one up, and scrunch the other up or leave it totally relaxed and it’s very frustrating to see how poorly handled eyebrow tracking is in general. Especially when eyebrows give so much emotion. I’m running this on an iPhone 15 Pro Max and I still can’t get the darn thing to just track my eyebrows. Instead it tracks only one eyebrow or weirdly mixes the motion of each eyebrow into one half-baked combo. Mostly it just makes my whole forehead look dead - like, I can’t even begin to tell you how important eyebrow motion is to conveying the emotions and thoughts of a character. Heck, it might be more important than every other facial feature combined. I’m ranting. I really wanted to love this - I really wanted to feel like it’s a game changer. But, it’s just kinda average. It’s largest selling point is that it’s integrated into Unreal and you can transfer simple mocap and reference footage from via the live link. I just wish the actual tracking was better.
Overall great app
07/23/2023

Highlander driver
One minor issue: if you record at 30 fps the resulting CSV file will have gaps on the data. By this I mean there are 16 frames with key frame data, followed by 16 more frames with no key frames at all, followed by another 16 with data. This pattern repeats for the entire recording. If you record at 60 fps, this bug does not occur. Just an FYI!

Developer Response
Hi! Thanks for your bug report. We are aware of this issue and are working towards a fix.
Overall great app
07/23/2023

Highlander driver

One minor issue: if you record at 30 fps the resulting CSV file will have gaps on the data. By this I mean there are 16 frames with key frame data, followed by 16 more frames with no key frames at all, followed by another 16 with data. This pattern repeats for the entire recording. If you record at 60 fps, this bug does not occur. Just an FYI!
Developer Response 08/08/2023
Hi! Thanks for your bug report. We are aware of this issue and are working towards a fix.
Add head translation data available
12/21/2021

DalekEx
This is a great app. May I ask whether the head translation data can also be available on the output CSV file?
Add head translation data available
12/21/2021

DalekEx

This is a great app. May I ask whether the head translation data can also be available on the output CSV file?

- Adds the ability to use any on-device front or rear facing camera. - Adds support for up to 120 FPS capture when using a non-TrueDepth camera. - Adds support for external USB cameras on USB-C equipped iPads. - Adds face mesh preview overlay in MetaHuman Animator mode. - Fixes bug on iPad where takes would be recorded in an incorrect orientation. - MetaHuman Animator mode is now available on devices without a TrueDepth camera.