Advertisement
Overview
User guide for "wav2lip"
When launching the app for the first time, it is necessary to wait patiently for 2 minutes. Because four models need to be copied to the relevant paths during the first launch.
The functions of "wav2lip" app mainly include: (1) Facial motion transfer; (2) Dynamically change lip shape according to audio.
This app has very low requirements for graphics card memory and can run smoothly on a computer with only 2GB of graphics card memory.
1. Facial motion transfer (Suitable for scenarios where there is only a photo of the anchor or digital person but no video. Facial motion transfer needs to refer to a video with a smaller amplitude of facial movement.)
(1) Click "SELECT A FACIAL IMAGE FILE" button below to be used to transfer motion. The facial image filename extension includes *.jpg, *.jpeg, *.png, *.bmp, *.tif, *.tiff, *.jfif and *.gif.
(2) Click "SELECT A FACIAL VIDEO FILE" button below to transfer motion. The video filename extension includes *.mp4, *.mkv, *.rmvb, *.avi, *.wmv, *.flv, *.mpeg, *.mpg, *.rm, *.mov, *.vob, *.3gp, *.dat, and *.asf.
(3) Click "SELECT AN OUTPUT FOLDER" button below to save transferred video. When the transferred video file is saved, a "Facial motion transfer" dialog box will pop up, displaying "Transfer motion successfully!". The transferred video filename is saved as "original video filename + timestamp.mp4".
2. Dynamically change lip shape according to audio(Suitable for scenarios where there is a video of the anchor or digital person.)
(1) Click "SELECT A FACIAL VIDEO FILE" button below. The video filename extension includes *.mp4, *.mkv, *.rmvb, *.avi, *.wmv, *.flv, *.mpeg, *.mpg, *.rm, *.mov, *.vob, *.3gp, *.dat, and *.asf.
(2) Click "SELECT AN AUDIO FILE" button below. The audio filename extension includes *.mp3, *.wav, *.ogg, *.m4a, *.flac and *.ape.
(3) Click "SELECT AN OUTPUT FOLDER" button below to save a synthesized video file, which dynamically changes lip shape according to audio. When the synthesized video file is saved as "original video filename + timestamp.mp4", a "wav2lip" dialog box will pop up, displaying "Dynamically change lip shape according to speech successfully!".
Note:
(1) If the audio file contains accompaniment, it is necessary to separate the vocals from the audio. "separate audio" app can separate audio into vocals and accompaniment: https://www.microsoft.com/store/apps/9PCPLT8JGXL6
(2) If the audio file need to convert text to speech, it is recommended to choose the "txt2voice" app, which uses Microsoft Edge TTS artificial intelligence speech technology to convert text in multiple languages into high-quality audio, including 74 languages and the voices of over 300 announcers: https://www.microsoft.com/store/apps/9NGZQ2WPQCCV
"wav2lip"中文使用指南(User guide in Chinese)
在首次启动应用程序时,需要耐心等待两分钟。因为当第一次启动软件时需要将四个模型复制到相关路径。
"wav2lip"应用程序的功能主要包括:(1)面部动作迁移;(2)根据音频动态地改变唇形。
应用程序对显卡显存的要求很低,在电脑的显卡显存仅2G的配置下,也能流畅运行。
1. 面部动作迁移 (适用于只有主播或数字人的一张照片但是没有视频的场景。面部动作迁移需要参考一个面部动作幅度较小的视频。)
(1) 点击下面的“选择面部图像文件”("SELECT A FACIAL IMAGE FILE")按钮,用于迁移面部动作。面部图像文件扩展名包括*.jpg、*.jpeg、*.png、*.bmp、*.tif、*.tiff、*.jfif和*.gif。
(2) 点击下面的“选择面部视频文件”("SELECT A FACIAL VIDEO FILE")按钮以迁移面部动作。视频文件扩展名包括*.mp4、*.mkv、*.rmvb、*.avi、*.wmv、*.flv、*.mpeg、*.mpg、*.rm、*.mov、*.vob、*.3gp、*.dat和*.asf。
(3) 点击下面的“选择输出文件夹”("SELECT AN OUTPUT FOLDER")按钮保存迁移的视频。保存迁移的视频文件后,将弹出“面部动作迁移”("Facial motion transfer")对话框,显示“迁移动作成功!”("Transfer motion successfully!")。迁移后的视频文件名被保存为“初始视频文件名+时间戳”。
2. 根据音频动态改变唇形 (适用于有主播或数字人的一个视频的场景。)
(1)点击下面的“选择面部视频文件”("SELECT A FACIAL VIDEO FILE")按钮。视频文件扩展名包括*.mp4、*.mkv、*.rmvb、*.avi、*.wmv、*.flv、*.mpeg、*.mpg、*.rm、*.mov、*.vob、*.3gp、*.dat和*.asf。
(2)单击下面的“选择音频文件”("SELECT AN AUDIO FILE")按钮。音频文件扩展名包括*.mp3、*.wav、*.ogg、*.m4a、*.flac和*.ape。
(3) 点击下面的“选择输出文件夹”("SELECT AN OUTPUT FOLDER")按钮保存合成的视频文件,该文件会根据音频动态地改变嘴唇形状。当合成的视频文件被保存为“初始视频文件名+时间戳.mp4”(注意文件名会覆盖)时,将弹出“wav2lip”对话框,显示“成功地根据语音动态地改变唇形!”("Dynamically change lip shape according to speech successfully!")。
注意:
(1)如果音频文件包含伴奏,则有必要将人声从音频分离。“分离音频”("separate audio" )应用程序可以将音频分为人声和伴奏:https://www.microsoft.com/store/apps/9PCPLT8JGXL6
(2)如果音频文件需要将文本转换为语音,建议选择"文本转语音"("txt2voice")应用程序,该应用程序使用 Microsoft Edge TTS 人工智能语音技术将多种语言的文本转换为高质量的音频,包括74种语言和300多名播音员的声音:https://www.microsoft.com/store/apps/9NGZQ2WPQCCV
Features
The functions of "wav2lip" app mainly include: (1) Facial motion transfer; (2) Dynamically change lip shape according to audio. The app can run with only 2GB of graphics card memory.
Additional Information
- Developed by Email: [email protected]
- Version 2025.01.03
-
Requires
Available on: PC
OS: Windows 10 version 17763.0 or higher
- Published 2025-01-03
- Size 1.78 GB
- File Type appx/msix
-
Language
Chinese (Simplified)
-
Permissions
Uses all system resources
- Microsoft Store ID 9nhp969ln8bb
Advertisement
How to download and install wav2lip from the Microsoft
Method 1: Download and Install via the Microsoft Store
This is the most straightforward and secure way to get wav2lip.Step 1: Open the Microsoft Store
Step 2: Search for wav2lip
Step 3: Download and Install
Step 4: Access the App
Method 2: Download from the Official Microsoft Website
If you prefer downloading directly from the web, you can use the official Microsoft website.Step 1: Visit the wav2lip Page
Step 2: Download the App
Step 3: Install wav2lip
Step 4: Use wav2lip
Tips for a Smooth Installation
Conclusion:
Both methods ultimately utilize the Microsoft Store, ensuring the app's safety and reliability. Whether you prefer browsing within the Store or starting via the website, both approaches lead you to successfully download and install wav2lip.wav2lip FAQs
How to download and Install wav2lip on Windows PC via the NWindows Store
How to Search and Download wav2lip for PC Windows?