Verfahren und System zur Erzeugung Emotionaler Sprechender Kopfvideos mit Entwirrter Pose und Expressionsflussführung

Details

Veröffentlichungs-Nr.

EP4787335

Anmeldetag

12. Dezember 2025

Veröffentlichung

5. August 2026

Rechtsraum

EP

IPC

G06V10/82, G06V40/16

Abstract

This disclosure relates generally to method and system for generating emotional talking head video using disentangled pose and expression-flow guidance. Generating realistic one-shot emotional talking head animation on arbitrary faces is a challenging problem, as it requires realistic emotions, head movements, identity preservation, and accurate lip sync. The method receives a plurality of inputs comprising an identity image, a speech audio input data and an emotion input data to generate emotional talking head video. Further, the plurality of inputs are utilized to generate one or more pose landmarks using the pose generation network, and one or more pose landmarks are generated using the expression generation network. Finally, an image generation network generates emotional talking head video using disentangled optical flow computation for pose-guided and expression-guided motion using one or more expression-invariant pose landmarks and pose-invariant emotion landmarks. Additionally, the method generates accurate facial emotions and emotion accuracy on benchmark datasets.

Anmelder

Firma

Tata Consultancy Services Limited

Land

🇮🇳 Indien

Fachgebiete