The Facial Tracking capability enabled by iPhone X has proven it’s accuracy and performance with its entertainingly impressive Animojis. Due to the built-in Depth Camera, the iPhone X's face tracking is highly accurate under most lighting conditions, providing a solid facial motion capture data source.
LIVE FACE is designed to stream the iPhone X's facial tracking data to desktop clients. After launching LIVE FACE, users can WiFi connect desktop clients either through iPhone hotspots, or computers sharing the same WiFi source. Just type in the IP address in the client site to enable the data feed.
LIVE FACE now supports CrazyTalk Animator 3, a Mac and PC application for 2D animation and custom character design. After setting up the IP connection, CTA3 users can realtime animate cartoon characters’ facial features including; eyeballs, eye brows, mouth shapes, and head rotation. Besides generating realtime live shows, users can also record the animated data for further editing.
In CTA3, the signal level of the facial features (Eyes, Brows, Eyelids, Mouth, Head) can be further augmented or diminished, via strength sliders, allowing users to fine-tine how expressive they wish character be during final recording.
Application programs prepare:
1.) Install CrazyTalk Animator 3.3 Pro version from the Mac app store to the Mac computer. (Apple ID: 1189506284)
2.) Use iPhone X to install LIVE Face from the iOS app store. (Apple ID: 1357551209)
. Environment setting:
1.) Turn on the iPhone X hotspot.
2.) Have the Mac computer connect to the iPhone X hotspot via USB.
*Please take note, that both programs need to connect to the same wifi domain.
. Set up application programs :
1.) Open the LIVE Face app on your iPhone X , you will see the message "Please connect your client software" popup.
2.) Open the CTA3.3 app on your Mac computer and import a character from the Content Manager on the right. (Actor tab/Character folder/1_G3 Human folder/Elastic Folks_Female_01_F.ctTBactor)
3.) Launch the facial mocap from the right-toolbar.
4.) Click on the "Server Setting" button in the top of the Facial Mocap panel, and you will see the server setting panel.
5.) Enter your IP address and Port number.
6.) Click on "OK".
*Note: If the connection failed, please check your IP address & Port number, and reconnect again .
7.) Click on the "Preview" or "Record" button, and you will see a popup message "please press SPACE key to preview/record".
8.) Press the SPACE bar to start your facial motion capture.
Added: Supports Ethernet Connector
Fixed: Resolved sticky package issue for smoother results
Ratings and Reviews
App for professional animators
This is a professional application for animators, and ties to IClone 7. The suite of software is broken into different programs, so you can mix and match for your needs. If you want to make and export facial animations with YOUR rigged character, the combo costs $1,150 USD, and requires an IPhone X at a market rate of $1200. This app extension is specifically for capturing the facial performance, and streams to the actual program, loaded on your computer.
Context- well worth it. The next cheapest facial animation software cost $3500 and had such a horrific customer experience (and software that sometimes didn’t work well) that I converted to this, and have been much happier.
There is one review claiming it’s terrible because you need a $300 plugin. It really depends on where you’re coming from. This software is a tool, and not something for amateurs who just want an emoji app.
About $800 if you want it to be useful
So I was considering buying the RealIllusion software to import iPhone X face tracking data and assign it to a 3D character.
In addition to all the core software needed for this (>$800), RealIllusion wants another $400 for the iPhone connector software.
- Reallusion Inc.
- 13.6 MB
Requires iOS 11.0 or later. Compatible with iPhone 6S, iPhone 6S Plus, iPhone SE, iPhone 7, iPhone 7 Plus, iPhone 8, iPhone 8 Plus, iPhone X, iPhone XS, iPhone XS Max, iPhone XR, iPhone 11, iPhone 11 Pro, iPhone 11 Pro Max, iPad Pro (12.9-inch), iPad Pro (12.9-inch) Wi-Fi + Cellular, iPad Pro (9.7‑inch), iPad Pro (9.7-inch) Wi‑Fi + Cellular, iPad (5th generation), iPad (5th generation) Wi‑Fi + Cellular, iPad Pro (12.9‑inch) (2nd generation), iPad Pro (12.9‑inch) (2nd generation) Wi‑Fi + Cellular, iPad Pro (10.5‑inch), iPad Pro (10.5-inch) Wi‑Fi + Cellular, iPad (6th generation), iPad Wi-Fi + Cellular (6th generation), iPad Pro (11-inch), iPad Pro (11-inch) Wi-Fi + Cellular, iPad Pro (12.9-inch) (3rd generation), iPad Pro (12.9-inch) (3rd generation) Wi-Fi + Cellular, iPad mini (5th generation), iPad mini (5th generation) Wi-Fi + Cellular, iPad Air (3rd generation), iPad Air (3rd generation) Wi-Fi + Cellular, iPad (7th generation), iPad (7th generation) Wi-Fi + Cellular, and iPod touch (7th generation).
- Age Rating
- Rated 4+
- © 2018 Reallusion Inc
With Family Sharing set up, up to six family members can use this app.