Runtime MetaHuman Lip Sync
Documentation for the Runtime MetaHuman Lip Sync plugin.
Downloads & Links
Demo Projects:
Two ready-to-use demo projects are available - see the dedicated Demo Projects page for full details, downloads, and walkthroughs:
- Full AI Conversational NPC Workflow - speech recognition + LLM chatbot + TTS + lip sync
- Basic Lip Sync Demo - microphone input, audio files, TTS
Both demos are cross-platform (Windows, Mac, Linux, iOS, Android, Meta Quest) and ship as packaged builds and full UE 5.6+ source projects.
Video Tutorials
Featured Demos
Realistic Model (High-Quality) Tutorials
- High-Quality Lip Sync from Audio File/Buffer
- High-Quality Lip Sync with Mood Control & Local TTS
- High-Quality Lip Sync with ElevenLabs & OpenAI TTS
- High-Quality Live Microphone Lip Sync
Standard Model Tutorials
- Standard Live Microphone Lip Sync
- Standard Lip Sync with Local Text-to-Speech
- Standard Lip Sync with ElevenLabs & OpenAI TTS
General Setup
- Adding a Custom MetaHuman Character to the Demo Project
- Setup tutorial video
- Demo project walkthrough (older)
Support
- Plugin Support & Custom Development: solutions@georgy.dev (tailored solutions for teams & organizations)
Overview
Runtime MetaHuman Lip Sync Documentation
Setup Guide
This guide walks you through the basic setup process for Runtime MetaHuman Lip Sync with your MetaHuman characters.
Audio Processing Guide
Learn how to set up different audio input methods for lip sync, including microphone, TTS, and streaming audio sources.
Plugin Configuration
Learn how to configure lip sync models, animation blueprints, mood settings, performance options, and troubleshoot common lip sync issues.
How to use the plugin with custom characters
This guide walks you through the process of setting up Runtime MetaHuman Lip Sync for non-MetaHuman characters. This process requires familiarity with animation concepts and rigging. If you need assistance implementing this for your specific character, you can reach out for professional support at solutions@georgy.dev.
Platform-specific Configuration
This guide covers platform-specific setup requirements and configurations for the Runtime MetaHuman Lip Sync plugin.
Demo Projects
Ready-to-use demo projects showcasing Runtime MetaHuman Lip Sync, including a full AI conversational NPC workflow with speech recognition, LLM integration, TTS, and lip sync.