Articles on: Setup
This article is also available in:

Getting started with playAbility

Getting Started with PlayAbility

This guide gives you a quick overview to help you explore all the main ways to use PlayAbility — from face tracking to advanced input conversions.


What is PlayAbility?

PlayAbility is a powerful adaptive control app for Windows that lets you play any game by combining your existing devices with new input methods like:

  • Facial gestures (smile, blink, raise eyebrows, open mouth…)
  • Head tracking (turn, tilt, nod)
  • Voice commands (say “jump”, “reload”, or any custom phrase)
  • Mouse, keyboard, and gamepad inputs

You can mix and map these freely to control games, apps, or even your entire computer.


Key Features

  • Create custom profiles for every game or use case.
  • Map any face, head, voice, or hardware input to any gamepad, keyboard, or mouse output.
  • Turn head motion into a joystick, mouse, or trigger control.
  • Convert mouse movement into gamepad stick actions (useful for driving or aiming).
  • Add voice commands in 24 languages for quick actions.
  • Use adaptive controllers (Xbox Adaptive Controller, Hori Flex, OpenRudder, etc.) together with PlayAbility.
  • Play on Xbox, PlayStation, or Switch via adapters or Remote Play.


Installation

  1. Download PlayAbility from the official site.
  2. Run the installer and follow the on-screen instructions.
  3. If Windows displays a warning, it’s safe to allow the installation.

Once installed, you can immediately create and test your first profile.


Creating a Profile

A profile defines how your inputs are translated into game actions.


Built-In Profile Templates

PlayAbility includes the following updated templates to help you get started quickly:

  • Head Stick & Face Gestures – steer or move with your head, trigger buttons with facial expressions.
  • Racing Game – use your head to steer, raise or lower brows to accelerate and brake.
  • Full Gamepad – complete Xbox-style controller mapping for advanced users.
  • Head Mouse + Smile Click – control the cursor with your head, click or scroll with facial gestures.
  • Keyboard Head Control – use head movements for WASD-style navigation.
  • Mouse Clicks Only – simple profile for face-based left/right clicking.
  • Twitch Chat Control – integrate live Twitch chat commands as triggers.
  • Voice & Gesture Hybrid – combine voice commands with head or face inputs for hands-free gameplay.
  • Blank Profile – start from scratch and create your own unique setup.

You can duplicate, modify, or merge profiles to fit your needs.


Quick Setup

  1. Open PlayAbility.
  2. Go to the Profiles tab.
  3. Click + Add new profile.
  4. Choose one of the templates above.
  5. Add triggers (face, head, voice, keyboard, mouse…)
  6. Assign outputs (keyboard keys, gamepad buttons, analog sticks, etc.)

💡 Tip: Mix different input types in the same profile — for example, head movement for aiming, facial gestures for actions, and voice for quick commands.


Using Facial Gestures

  1. Go to Settings → Face Detection.
  2. Make sure your webcam is selected.
  3. Click Start Face Detection.
  4. Test gestures like smile, blink, or raise eyebrows.
  5. Assign them to any action (press button, hold trigger, move stick, etc.).

Examples:

  • Left smile → A button (jump)
  • Raise eyebrows → Right trigger (accelerate)
  • Blink left eye → Left click


Head Tracking

Turn your head into a joystick, mouse, or steering control.

  1. Enable Head Tracking in settings.
  2. Press Calibrate Head Stick to center your neutral position.
  3. Map your movements:
    • Yaw (turn left/right) → steering or left stick X-axis
    • Pitch (nod up/down) → aim or right stick Y-axis
    • Roll (tilt) → shoulder buttons or triggers

You can also use headMotionMouse mode to move the system cursor with your head.


Converting Mouse to Gamepad Controls

PlayAbility can transform any mouse movement into analog stick motion — perfect for games that only support controllers.

Examples:

  • Move mouse → Right stick (camera control)
  • Left click → A button (jump)
  • Right click → LT (aim)
  • Scroll wheel → Weapon switch (D-pad up/down)

This lets you play PC-only games with controller input or adapt console games to mouse-like aiming.


Voice Commands

You can say words or short phrases to trigger in-game actions.

  1. Open Voice Settings.
  2. Enable microphone access.
  3. Add new voice commands (e.g. “fire”, “jump”, “reload”).
  4. Assign each to any button or key.

Examples:

  • “Jump” → Spacebar
  • “Reload” → X button
  • “Boost” → Right trigger


Connecting with Consoles

PlayAbility outputs as a virtual Xbox controller, so it can connect to:

  • Xbox via the Xbox Adaptive Controller or PlayAbility Receiver.

How to connect to Xbox


  • PlayStation (PS4/PS5) via Remote Play or the Chiaki client.

How to connect to PlayStation


  • Nintendo Switch 1 and 2 using the PlayAbility Adaptive Receiver (raspberry pi pico W or 2W)

How to connect to Switch


  • Xbox Adaptive Controller using the PlayAbility Adaptive Receiver (raspberry pi pico W or 2W)

How to connect to Xbox Adaptive Controller


Advanced Uses

  • Combine multiple inputs — e.g., head movement + facial gesture + voice.
  • Remap keyboard to controller or the reverse.
  • Simulate long or short presses automatically.
  • Control your PC hands-free — move mouse, click, or scroll.
  • Use Twitch integration so your chat can trigger in-game actions live.
  • Export and share profiles with the community.


Getting Help

If you need support or inspiration:


You’re now ready to explore, customize, and make PlayAbility truly yours.

Play your way — face, head, voice, or anything in between. 🎮

Updated on: 01/11/2025