iPhone 2D Facial Mocap for Real-time Cartoon & Live Show

Cartoon and 2D character animations have widely been used for everything from entertainment, to education, infographics and YouTube marketing but its labor intensive requirements have always prohibited live usage. Now the iPhone Facial Mocap for CrazyTalk Animator 3, allows you to do instant face motion capture on any 2D characters with the help of the TrueDepth Camera and a Wi-Fi connection to generate live shows for YouTube, Facebook or Twitch!

Free Trial Download

iPhone facial mocap works with CrazyTalk Animator (CTA), the world's easiest 2D animation software. Use a variety of 2D characters from the CTA Library or create your own to motion capture avatars in realtime for cartoons, videos, presentations or live broadcasts!

2D Character Creation and Animation Tool

Release Version: v3.3.3007.1
Platform: Mac / Windows
Release Date: June 14th, 2018
Trial Duration: Pipeline trial edition; 15 days

iPhone Facial Mocap App

Version: 1.0
Platform: iOS
Release Date: 2018.6.14
Expiration date: None
Limitation: iPhones with TrueDepth Camera

Super Fast Real-time Cartoon Animation Production

Turn any image into an animated character with the free bone tools or character templates.
Seamlessly connect with Photoshop through in/out PSD layered templates.
A proven daily tool for multi-million subscriber YouTuber production.

Add Virtual Hosts to Live Broadcasts

Works with major livestreaming tools including OBS, Xsplit, and FFSplit to superimpose talking characters on top of major broadcasting platforms like Twitch, YouTube, Mixer and Facebook.
Apply green screen backgrounds to realtime character performances for easy color keying.

Perform to Create Direct Facial Mocap

TrueDepth Camera of iPhone can track up to 57 face signals.
Accurately drive character facial expressions including; head angle, brows, eyeball rotation.
Simultaneously control 2D mouth sprites through live capture or via traditional audio lip syncing.
Connect an iPhone X to a PC or Mac through shared Wifi, Hot Spot, or USB cable.
View Manual >

Flexible Capture from Different Angles

Ideally, accurate mocap is done with an iPhone right in front of our face, but that's not always possible with a computer monitor infront. For this we provide the Zero Pose function for the best possible capturing results.
No matter where you place your iPhone, the unique Zero Pose design will quickly recalibrate the angle offset of your face, and accurately standardize the facial tracking in one-click!

View Manual >

Supports Various Face Profiles

CTA will automatically choose the appropriate face profile, for front-facing characters or an angled-facing character.
Optimized facial mocap for two major modes:
- Sprite-based characters animate by switching and deforming expression sprites.
- Image-based characters are made through the photo-fitting method and use morph animation.

View Manual >

Feature-based Facial Strength Filters

Control the signal input strength, globally or individually; for brows, eyelids, eyeballs, mouth, jaw, cheeks, and head rotation.
Easily capture stylized characters with the proper strength settings when toning down or exaggerating animated features.
Save your fine-tuned settings for specific characters, in a custom library.

View Manual >

Customize your Own Sprite-based Expressions

Custom import facial animation sprites, or convert whole expression set directly from Photoshop layers.

Fine-tune or exaggerate characters’ facial expressions by altering facial sprites, or adding different levels of Free Form Deformations (FFD) to each facial feature.

PSD Pipeline > View Manual >

Audio Recording and Timeline Editing

Not satisfied with the recorded lip motions? Then use the Timeline editor to quickly edit motion clips, alter speeds, blend or refine your captured phoneme expressions.
Turn on the PC microphone for simultaneous audio recording to have complete control over talking lip shapes.

View Manual >

Reuse Captured Motions on Different Characters

Through CrazyTalk’s universal facial architecture, recorded motion data can be cleverly used on other human or non-human characters.
The same facial animation data can drive both sprite-based and image-morph based characters, while being applicable for both front and angle facing actors.

View Manual >