Fiche de HARRANDO Ismail

Titre : Representation, Information Extraction, and Summarization for Automatic Multimedia Understanding
Date : 13 mai 2022
Heure: 09:30
Résumé : Multimedia content consumption is seeing an unprecedented rise, requiring the development of novel approaches to automatically understand it, analyze it, and better serve it to end users. In this thesis, we focus our research on three axes of media understanding: (1) Representing multimedia, through exploring the potential of two representations: as a knowledge graph, allowing advanced querying and navigation, and as embeddings, both semantic and textual, to be used for a content-based recommender system. (2) Describing multimedia, through the textual component of multimedia we can generate high-level descriptors for the content using IE methods. This can help end-users navigate, organize, and explore the content for different applications and generate better media representations. (3) Summarizing multimedia, as the content can be long and dense. We investigate the possibility of extracting highlights from media, both for narrative-focused summaries and for maximizing memorability.
Lieu : Biot, Sophia Antipolis