Live Link Face 4+

For Unreal Engine

Unreal Engine

    • 4.5 • 13 Ratings
    • Free

Screenshots

Description

Live Link Face for effortless facial animation in Unreal Engine — Capture performances for MetaHuman Animator to achieve the highest fidelity results or stream facial animation in real time from your iPhone or iPad for live performances.

Capture facial performances for MetaHuman Animator:

- MetaHuman Animator uses Live Link Face to capture performances on iPhone then applies its own processing to create high-fidelity facial animation for MetaHumans.
- The Live Link Face iOS app captures raw video and depth data, which is ingested directly from your device into Unreal Engine for use with the MetaHuman plugin.
- Facial animation created with MetaHuman Animator can be applied to any MetaHuman character, in just a few clicks.
- This workflow requires an iPhone (12 or above) and a desktop PC running Windows 10/11, as well as the MetaHuman Plugin for Unreal Engine.

Real time animation for live performances:

- Stream out ARKit animation data live to an Unreal Engine instance via Live Link over a network.
- Visualize facial expressions in real time with live rendering in Unreal Engine.
- Drive a 3D preview mesh, optionally overlaid over the video reference on the phone.
- Record the raw ARKit animation data and front-facing video reference footage.
- Tune the capture data to the individual performer and improve facial animation quality with rest pose calibration.

Timecode support for multi-device synchronization:

- Select from the iPhone system clock, an NTP server, or use a Tentacle Sync to connect with a master clock on stage.
- Video reference is frame accurate with embedded timecode for editorial.

Control Live Link Face remotely with OSC or via the MetaHuman Plugin for Unreal Engine:

- Trigger recording externally so actors can focus on their performances.
- Capture slate names and take numbers consistently.
- Extract data for processing and storage.

Browse and manage the captured library of takes:

- Delete takes within Live Link Face, share via AirDrop.
- Transfer directly over network when using MetaHuman Animator.
- Play back the captured video on the phone.

What’s New

Version 1.4.0

- Adds the ability to toggle recording with the hardware volume buttons and bluetooth camera shutter devices.
- Adds an 'Always Send Face Pose' live link option to enable the continuous streaming of face pose and timecode information even if no face is currently detected.
- Improves Tentacle Sync device compatibility.
- Fixes issue where timecode values could become desynchronised with connected Tentacle Sync devices.

Ratings and Reviews

4.5 out of 5
13 Ratings

13 Ratings

Twitterヘビーユーザー改2 ,

これさえあれば神アプリ

頭のパラメータを回転だけでなくxyzの位置でも取る昨日と、スマホを横向きに設置してキャプチャしてる時のyawとpitchの逆転をキャリブレーションで補正できるようにして欲しいです。

基本的にパラメータも飛ぶことは無いしARKit準拠のperfect syncデータを送ってきてくれるので正確に顔トラで来て有難い。しかしながら、UDPで送られるシェイプデータが末尾244byte分4byteづつ61個のパラメータな事、更にビックエンディアン形式なことは何処からも見つけられない為、明記するなら明記した方が良いのではないかと思われます。

また、ここまで色々書きましたが無料でここまで高精度にトラッキング出来るソフトがある事は結局の所とても有難く、日々感謝しながら使用させて頂いております。感謝(ㅅ´ ˘ `)

顔のx,y,z位置の検出、お待ちしております(-人-)ナムナム…

App Privacy

The developer, Unreal Engine, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.

Data Not Collected

The developer does not collect any data from this app.

Privacy practices may vary, for example, based on the features you use or your age. Learn More

More By This Developer

RealityScan - 3D Scanning App
Photo & Video
Unreal Remote 2
Productivity
Unreal VCam
Graphics & Design
Unreal Remote
Utilities
Action RPG Game Sample
Games

You Might Also Like

MobileCap
Graphics & Design
Qlone 3D Scanner
Graphics & Design
Moves by Maxon
Graphics & Design
Nomad Sculpt
Graphics & Design
Forger
Graphics & Design
ZBrush
Graphics & Design