Screenshots

Beschreibung

Stream face animation from your IPhone / IPad into the Unreal Engine and let your 3D models get alive.

The Apple ARKit provides face tracking functionality on IOS devices with FaceID support. 51 blendshape values (relative movement values between 0->1) can be tapped and used for animating your own 3D faces.
Reference: https://developer.apple.com/documentation/arkit/tracking_and_visualizing_faces

On the other hand Unreal Engine provides a LiveLink interface, already prepared for receiving those ARKit blendshape values over UDP network protocol. And Unreal Engine includes ready to use controls and blueprint elements for integrating the values into your animation.
Reference: https://docs.unrealengine.com/en-US/Engine/Animation/LiveLinkPlugin/index.html

In this version 1.0 only the 51 known face blendshapes are transmitted. The Unreal Engine LiveLink API for ARKit supports 9 additional blendshape values, which express the relative transformation of the head. These currently not implemented blendshapes will be introduced in the next version.

Prerequesites:
- IOS device (IPhone / IPad) with FaceID support
- Unreal Engine 4.24 (LiveLink API version 5)
- Plugins: LiveLink, Apple ARKit, Apple ARKitFaceTracking

Usage:
- Launch Unreal Engine
- Open Window->LiveLink in Unreal Engine
- Launch LiveLink UE MoCap on your IOS device
- Open settings, and insert the IP of the computer running Unreal Engine
- Enable the connect switch.

Now you should see your Phone in the Unreal Engine's LiveLink window.

Bewertungen und Rezensionen

4.0 von 5
2 Bewertungen

2 Bewertungen

hihi1324 ,

Dose not work on iPhone 6s

When i open the app is said that face tracking is not supported on this device. In the Information section of the App Store it said it works in iPhone 6s. Am I doing something wrong?

App-Datenschutz

Der Entwickler (Markus Pfau) hat Apple keine Details über seine Datenschutzpraktiken und seinen Umgang mit Daten zur Verfügung gestellt. Weitere Infos findest du in der Datenschutzrichtlinie des Entwicklers.

Keine Details angegeben

Der Entwickler muss bei der Übermittlung seiner nächsten App-Aktualisierung Angaben zum Datenschutz machen.

Support

  • Familienfreigabe

    Wenn die Familienfreigabe aktiviert ist, können bis zu sechs Familienmitglieder diese App verwenden.

Das gefällt dir vielleicht auch