Use Face Gestures as Controls
PlayAbility detects face movements from your webcam and groups the available gestures under Mouth, Brows, and Eyes. Choose gestures that are comfortable, visually distinct, and easy for you to repeat.
Prepare face detection
- Open Settings > General.
- Under Webcam, select the camera you want to use.
- Position the camera so your face is visible from the front.
- Use even front lighting and avoid a bright window directly behind you.
- Start Face Detection beside the webcam preview.
If you are unsure which gesture to use, open Face Tester first and compare its live values while resting and while making each gesture.
Create a face-gesture trigger
- Open the current profile in Mapping.
- Add the action you want to control, or find an existing action without a trigger.
- Select Select a trigger on that action.
- Select Create a new trigger +.
- Under How do you want to control it?, select Face Gestures.
- Browse the Mouth, Brows, and Eyes tabs.
- Select the gesture you want to use.
- Adjust its activation settings.
- Choose an Action Mode when needed.
- Select Save.
Examples include mapping a smile to a gamepad button, an eyebrow raise to a keyboard key, or an open jaw to a mouse click. The gesture list includes separate left and right movements where the face model can distinguish them.
Tune the activation
Use these settings to match the trigger to your movement:
- Sensitivity Threshold sets the point at which the gesture becomes active. A lower value activates more easily; a higher value requires a stronger detected gesture.
- Maximum sensitivity may appear for progressive gamepad axes or triggers. It sets the detected value that produces the maximum output.
- Trigger when below threshold reverses the usual rule. Use it when the intended state has a lower score, such as a closed or lowered feature.
- Detection Delay requires the gesture to remain active for the selected time before a non-progressive action fires. A short delay can prevent accidental presses.
- Action Mode controls what happens after activation. Default stays active while the gesture is detected; press modes send fixed-duration presses; Toggle switches the action on or off with each activation.
Start with the neutral face score below the activation threshold and the deliberate gesture score clearly above it. If the two values are close, choose a different gesture instead of forcing an unreliable threshold.
Verify the trigger
- Make sure Face Detection and Main Output are enabled.
- Relax your face and confirm the mapping remains inactive.
- Perform the gesture several times and confirm the mapping activates each time.
- Look away, speak, and make normal expressions to check for accidental activations.
- Test the resulting action in the target game or app.
Troubleshooting and limitations
No face gestures respond
Check that Face Detection is running and that the correct webcam is selected in Settings > General. Confirm Windows camera permission and close another app if it has exclusive control of the camera.
The gesture triggers constantly
Raise the threshold, turn off Trigger when below threshold if it was enabled unintentionally, or select a gesture with a lower resting score. A short Detection Delay can filter brief expressions.
The gesture never reaches the threshold
Lower the threshold and inspect the gesture in Face Tester. Improve lighting, face the camera more directly, and make sure the selected left- or right-side gesture matches the movement you are testing.
Looking away causes unwanted actions
In Settings > Advanced, enable Require facing camera and tune its sensitivity. This prevents face-gesture mappings from firing when PlayAbility determines that you are not facing the camera.
Tracking varies during a session
Changes in lighting, camera position, glasses, facial hair, posture, and distance can change detected values. Retest and tune the threshold in the conditions in which you will use the profile.
A face gesture is uncomfortable
Do not keep a control that causes strain. Choose another face gesture, head movement, voice command, physical input, or combination of triggers that is easier to use repeatedly.
Updated on: 29/07/2026