Runtime MetaHuman Lip Sync

Documentation for the Runtime MetaHuman Lip Sync plugin.

Downloads & Links

• Get it on Fab
• Product website

Demo Projects

Speech-to-Speech Demo (Full AI Workflow)

• Download Speech-to-Speech Demo (Windows) ⭐ NEW
• Download Speech-to-Speech Demo source files (UE 5.6+) ⭐ NEW – Showcases full speech recognition + AI chatbot + TTS + lip sync workflow. Requires this plugin + Runtime Audio Importer + Runtime Speech Recognizer + Runtime AI Chatbot Integrator + Runtime Text To Speech (optionally). Standard model requires a small extension plugin (see here)

Basic Lip Sync Demo

• Download Demo (Windows)
• Download Demo source files (UE 5.6+) – Showcases basic lip sync workflows (microphone input, audio files, TTS). Requires this plugin + Runtime Audio Importer, optional: Text To Speech / AI Chatbot. Standard model requires a small extension plugin (see here)

Video Tutorials

Featured Demos

• Speech-to-Speech AI Assistant Demo ⭐ NEW
• Realistic Model Demo – Enhanced Accuracy

Realistic Model (High-Quality) Tutorials

• High-Quality Lip Sync with Mood Control & Local TTS
• High-Quality Lip Sync with ElevenLabs & OpenAI TTS
• High-Quality Live Microphone Lip Sync

Standard Model Tutorials

• Standard Live Microphone Lip Sync
• Standard Lip Sync with Local Text-to-Speech
• Standard Lip Sync with ElevenLabs & OpenAI TTS

General Setup

• Setup tutorial video
• Demo project walkthrough (older)

Support

• Plugin Support & Custom Development: solutions@georgy.dev (tailored solutions for teams & organizations)

Join our Discord

online · support

📄️Overview

Runtime MetaHuman Lip Sync Documentation

📄️Setup Guide

This guide walks you through the basic setup process for Runtime MetaHuman Lip Sync with your MetaHuman characters.

📄️Audio Processing Guide

This guide covers how to set up different audio input methods to feed audio data to your lip sync generators. Make sure you've completed the Setup Guide before proceeding.

📄️Plugin Configuration

Model Configuration

📄️How to use the plugin with custom characters

This guide walks you through the process of setting up Runtime MetaHuman Lip Sync for non-MetaHuman characters. This process requires familiarity with animation concepts and rigging. If you need assistance implementing this for your specific character, you can reach out for professional support at solutions@georgy.dev.

📄️Platform-specific Configuration

This guide covers platform-specific setup requirements and configurations for the Runtime MetaHuman Lip Sync plugin.