Gesichts- und Augenverfolgung sowie Gesichtsanimation mit Gesichtssensoren in einer Kopfmontierten Anzeige

Details

Veröffentlichungs-Nr.

EP3252566

Aktenzeichen

EP16200100

Anmeldetag

22. November 2016

Veröffentlichung

6. Januar 2021

Erteilung

6. Januar 2021

Rechtsraum

EP

IPC

G06F3/01H04N5/74G02B27/01G06K9/00

Abstract

A head mounted display (HMD) in a VR system includes sensors for tracking the eyes and face of a user wearing the HMD. The VR system records calibration attributes such as landmarks of the face of the user. Light sources illuminate portions of the user's face covered by the HMD. In conjunction, facial sensors capture facial data. The VR system analyzes the facial data to determine the orientation of planar sections of the illuminated portions of face. The VR system aggregates planar sections of the face and maps the planar sections to landmarks of the face to generate a facial animation of the user, which can also include eye orientation information. The facial animation is represented as a virtual avatar and presented to the user. A facial tracking system generates a virtual rendering of a portion of a face of a user wearing a head-mounted display (HMD). The facial tracking system illuminates portions of the face inside the HMD. The facial tracking system captures a plurality of facial data of the portion of the face using one or more facial sensors located inside the HMD. A plurality of planar sections of the portion of the face are identified based at least in part on the plurality of facial data. The plurality of planar sections are mapped to one or more landmarks of the face. Facial animation information is generated based at least in part on the mapping, the facial animation information describing a portion of a virtual face corresponding to the portion of the user's face.

Anmelder

Firmen

Facebook Technologies, LLC
Oculus VR, LLC

Land

🇺🇸 USA

Fachgebiete