MOSAIC CNECT 2023

A multilingual multimodal centralised AI-based hub for the European media content market

mosaic logo is just textMOSAIC MOSAIC has the objective to develop a prototypical European AI-enhanced platform, serving as a central, scalable hub for broadcasters and news creators, distributors and consumers. The platform will enable the leveraging of knowledge repositories by a sophisticated, multilingual and multimodal AI-based integrated system linking to producers and making use of the abundance and richness of cultural heritage, media and news repositories, whilst providing a source of monetisation from accumulated knowledge repositories.

INFALIA in MOSAIC
is responsible for the integration of AI tools for intuitive content searching and categorisation, improving user access and navigation.

INFALIA will provide a web-based end-to-end AI-based platform capable of analysing, understanding, and automatically annotating multimedia content. The platform integrates various modules capable of processing, understanding, and tagging multimedia content. MAAM currently offers advanced content-based image and video retrieval that enables the quick identification of visually similar or near-duplicate multimedia (image or video) content. Various content analysis modules can be easily integrated to automatically tag image and video, currently including short captioning of an image or video scene, visual object, action and person recognition and content type identification (e.g., disturbing content). The platform therefore will serve as a multimedia repository for media professionals, extending its functionalities according to the needs of broadcasters in MOSAIC. Example adaptations could include improved management of annotations and flags by multiple tools, better support for the ingestion of media assets from different sources and AI model training for recognising particular objects, actions or persons that are of interest to broadcasters.

Call: CNECT 2023
Budget: 3.009.857 €
Topic: MOSAIC is co funded by DIGITAL EUROPE grant no. 479833
Duration: 18 months