EMO generates dynamic portrait videos from a portrait image and human speech audio file. It consists of two models: EMO-detect verifies input image requirements, and EMO generates the video.
Model overview
About the models
- EMO-detect is an image detection model that verifies whether input images meet EMO's portrait requirements.
- EMO is a portrait video generation model that generates dynamic portrait videos from a portrait image and human speech audio file.
Example outputs
| Input: portrait image + audio file | Output: dynamic portrait video |
|---|---|
Portrait: Audio: See video on the right | Video:Style intensity: Active ("style_level": "active") |
Portrait: Audio: See video on the right | Video:Style intensity: Normal ("style_level": "normal") |
Portrait: Audio: See video on the right | Video:Style intensity: Calm ("style_level": "calm") |
The examples above were generated by the Qwen app, which integrates EMO.
Pricing and rate limits
Mode | Model name | Unit price | QPS limit for job submission | Maximum concurrent jobs |
|---|---|---|---|---|
Model call | emo-detect-v1 | Pay-as-you-go: USD 0.000574 per image | 5 | No limit for synchronous calls |
emo-v1 | Pay-as-you-go:
| 1 Only one job runs at a time. Other jobs wait in the queue. |
Prerequisites
Enable the service and obtain your API key: Obtain your API key and API host.
Call the models
-
To call the models (pay-as-you-go):
- Call EMO-detect to verify that your input image meets the requirements. See EMO image detection for details.
- Call EMO with the original image, region parameters from EMO-detect, and a clear human speech audio file to generate the video. See EMO video generation for details.