Erzeugung von Interaktionen zwischen Menschlichen und Dreidimensionalen Objekten unter Verwendung Neuronaler Sprachmodelle

Details

Veröffentlichungs-Nr.

EP4819055

Anmeldetag

20. März 2026

Veröffentlichung

7. Oktober 2026

Rechtsraum

EP

IPC

G06T13/00

Abstract

A method for 3D human-object interaction generation using neural language models is disclosed. The method includes receiving an input comprising an interaction location and a text prompt. A text-to-image generation model is applied on the text prompt. Initial differential parameters for a 3D parametric model representing the person in an interaction image are determined and a plurality of 2D views of the 3D environment is extracted. A sequence of prompts is prepared based on the plurality of 2D views and a neural language model is applied to the sequence of prompts. Loss function is initialized based on a set of body parts and a set of locations. The initial differential parameters are iteratively updated based on the loss function to obtain final differential parameters. The 3D parametric model is rendered in the 3D environment based on the final differential parameters.

Anmelder

Firmen

FUJITSU LIMITED
Carnegie Mellon University

Land

🇯🇵 Japan

Fachgebiete