LipSync Documentationbeta

Welcome to the new online documentation for LipSync Pro and Lite.
This area will be updated with new information and tutorials when available.



Back

Components - Eye Controller

Eye Controller is a separate component for adding automatic eye movements and blinking to your characters. It's designed to work alongside the LipSync component while sharing a Blend System, but can also be used on its own.


Using the Eye Controller Component

The Eye Controller component is simple to set up. Like the LipSync component, it can be attached to any GameObject, but is usually put on the root object of the character it controls. After adding a new Eye Controller component, you will need to assign a Blend System to it. This is done by choosing one from the dropdown.

If there is more than one BlendSystemUser (E.G. LipSync or Eye Controller) on the same GameObject, and the same Blend System is selected for both, the Blend System's settings will be shared between them. In the case of the Blend Shape Blend System, this means they will use the same list of meshes.
If a different Blend System is chosen, the two components will function completely separately.

With a Blend System selected, the editor will resemble the following image:

Each of Eye Controllers features can be enabled or disabled independently. Additionally, Blinking and Random Looking can both function in either Classic or Pose-Based modes.

Blinking

This feature will add a simple random blinking effect to your character. In Classic mode, two blendables are chosen - one for each eye.
Pose-Based mode replaces these with a single LipSync-style Pose that will be used in their place, allowing for the use of bones as well as an arbitrary number of blendables.

Blink Gap controls how often blinking occurs. The gap between each blink will be a random number of seconds between the two values here.
Blink Duration is the length of time, in seconds, each blink takes. The blendables/pose will be blended to over the first half of this time, then blended out over the second.

Random Looking

Enabling this feature will also show the 'Looking (Shared)' box.
This feature is used to add a randomised looking around effect to help make characters look more alive and interesting, even when there isn't anything specific for them to be looking at.

In either mode, the only option in this section is Change Direction Gap. Much like the Blink Gap, this is the range that controls how often the eyes will turn to look in a new direction.
The rest of the options are contained in the 'Looking (Shared)' section.

Look At Target

This feature is used to make the eyes point at a certain position in the world. For example, it can be used to allow for eye contact in VR games or FPSes, or for making a player character look at objects they can interact with.
Note that this feature is not available when using Pose-Based mode for Random Looking, as it relies on having objects it can point towards a target.
The following options are available for this feature:
Target is the Transform that the eyes will point towards.
Use Auto Target will enable or disable the automatic target-finding feature. This will make the eyes look towards the closest Transform that has a certain tag. When enabled, it reveals more options:

Auto Target Tag is the tag that identifies possible targets, and Auto Target Distance is the maximum distance between the character and a target. If a target is further away, it won't be looked at.
Look At Amount is a 0-1 value that can be used to smoothly enable or disable Look At Target. At 0, any targets (manual or automatic) will be ignored, and Random Looking will be used if it's enabled. At 1, Random Looking will be ignored, and the eyes will be looking straight at the target.

Looking (Shared)

These options are shared between both Random Looking and Look At Target.
Only the Eye Turn Speed option is available in both Classic and Pose-Based modes. Higher values will make the eyes turn faster.

In Classic mode:
Left/Right Eye Look At Bone are Transforms that represent the eyes. They will usually be a set of bones in the character's rig that control the eyes or, less commonly, the actual eye meshes themselves.
X/Y Axis Range controls how far along each axis the eyes are allowed to turn. In Random Looking mode, the random rotations will be within this range, and in Look At Target mode, the eye rotations will be clamped to avoid the eyes turning past these limits.
Eye Look Offset is an Euler angle rotation that will be applied to each eye. In Look At Target mode, the eye transforms will be pointed at the target along their local Z axis. If the bones/meshes are rigged differently, you can use this to counteract that, by rotating them 90 or 180 degrees back.


In Pose-Based Mode:
The previous options are replaced with 4 poses: Looking Up, Looking Down, Looking Left and Looking Right. These are blended between in Random Looking mode, with Looking Up being eyes up at their vertical limit, etc.

Back

Contents

Tutorials

Miscellaneous

Components

Editor Windows & Inspectors

  • Clip Editor
    • AutoSync Window Pro
    • Clip Settings Window
    • Marker Settings Window
    • Emotion Mixer Window
  • LipSync Inspector
    • Phonemes & Emotions
    • Gestures
    • Pose Extractor Wizard
    • Gesture Setup Wizard Pro
  • Project Settings
  • Extensions Window
  • Blend Shape Baker Pro