Sprach-Text-Ausrichtungsmaschine in einem System der Künstlichen Intelligenz

Details

Veröffentlichungs-Nr.

EP4787368

Anmeldetag

21. Januar 2026

Veröffentlichung

5. August 2026

Rechtsraum

EP

IPC

G10L15/26, G06F40/284

Abstract

Methods, systems, and computer storage media for providing speech-text alignment management using a speech processing engine in an artificial intelligence system are described. The speech processing engine includes a speech-text alignment engine that operates as intermediary between raw spoken language and its corresponding textual representation, ensuring real-time processing and translation tasks. The speech processing engine utilizes a speech encoder to convert spoken language into digital signals that represent its acoustic features. The data then passes through the speech-text alignment engine, which includes a Connectionist Temporal Classification (CTC) layer for temporal and sequence alignment and a modified q-former layer for fine-tuning the speech embeddings to closely match the latent space of text embeddings used by Large Language Models (LLMs). This alignment process enables translating or transcribing spoken content into multiple languages without delay. The speech processing engine also incorporates token swapping to support adapting to various speech patterns and accents effectively.

Anmelder

Firma

Microsoft Technology Licensing, LLC

Land

🇺🇸 USA

Fachgebiete