Skip to main content
NEWS

META INTRODUCES SEAMLESSM4T

By 23.08.2023July 11th, 2024No Comments
META INTRODUCES SEAMLESSM4T

23.08.2023 |

Meta has introduced SeamlessM4T, the first universal multimodal and multilingual translation model with artificial intelligence that allows users to communicate across language barriers. SeamlessM4T is currently available to researchers and developers under the appropriate license. The metadata of SeamlessAlign, the largest open-source multimodal translation dataset with 270,000 hours of learned speech, has also been published.

Creating a universal language translator is no easy task, and current speech-to-text and text-to-speech systems cover only a small fraction of the world’s languages. Building on the achievements of researchers around the world who have been striving for many years to create a universal translator, SeamlessM4T uses a unified systems approach to increase the efficiency and quality of translations by reducing errors and delays compared to segmented model methods. It leverages learnings from these efforts to provide multilingual and multimodal translation through a unified model built from disparate oral data sources, yielding state-of-the-art results. SeamlessM4T supports:

  • Speech recognition in almost 100 languages;
  • Speech-to-text conversion for nearly 100 input and output languages;
  • Speech-to-text conversion supporting nearly 100 input languages and 36 output languages;
  • Text-to-speech translation for nearly 100 languages;
  • Text-to-speech, supporting nearly 100 input languages and 35 output languages.

SeamlessM4T marks a new milestone in the development of artificial intelligence technology that bridges language gaps and facilitates connection and communication between people speaking different languages.

Details

Website

Target audience

Digital skills for all

Digital skills for the workforce

Digital skills for ICT professionals

Digital skills in education

Digital skills for children

Digital skills for public administration

Digital technology

Artificial Intelligence

Leave a Reply