The French National Research Agency Projects for science

Voir cette page en français

ANR funded project

CONTENUS ET INTERACTIONS Défi Multimédia : REconnaissance de PERsonnes dans des Emissions audiovisuelles (REPERE - CONTINT) 2010
Projet PERCOL

Person recognition in audiovisual content

The goal of the PERCOL proposal is to participate to the REPERE evaluation program by building a consortium including partners from the industry (Orange Labs) and academic labs (LIA, LIF, LIFL). The proposal is structured in 3 mains sections:
.
1) Using existing technology to cover the different modalities and tasks included in the REPERE evaluation program
This section is based on the use of modules already existing within the partners of the PERCOL project:
- Speaker segmentation and recognition
- Automatic Speech Recognition
- Optical Character Recognition of text within video
- Named Entity recognition
- Visage recognition
- Person recognition

2) Developing research, within the REPERE framework, allowing combining different scientific fields (audio, text and video) and moving forward the state of the art in each of them for performing the main task of REPERE. The two main scientific directions that are going to be addressed are:
- Multimodal fusion algorithms for automatic person recognition in video broadcast.
- Improving information extraction from speech and images thanks to a combine decoding using both modalities to reduce decoding ambiguities.

3) Introducing ergonomic analysis in the definition of the task. Thanks to tests with Orange Labs video retrieval platform users, we will work on the metrics that are going to be defined for the REPERE evaluation program.

Partners

FT FRANCE TELECOM

LIFL UNIVERSITE DE LILLE I [SCIENCES ET TECHNOLOGIES]

LIF UNIVERSITE AIX-MARSEILLE II [DE LA MEDITERRANEE]

UAPV UNIVERSITE D'AVIGNON ET DES PAYS DE VAUCLUSE

ANR grant: 397 800 euros
Beginning and duration: - 36 mois

 

ANR Programme: CONTENUS ET INTERACTIONS Défi Multimédia : REconnaissance de PERsonnes dans des Emissions audiovisuelles (REPERE - CONTINT) 2010

Project ID: ANR-10-CORD-0102

Project coordinator:
Monsieur Frédéric BECHET (UNIVERSITE AIX-MARSEILLE II [DE LA MEDITERRANEE])
Frederic.Bechet@nulllif.univ-mrs.fr

 

Back to the previous page

 

The project coordinator is the author of this abstract and is therefore responsible for the content of the summary. The ANR disclaims all responsibility in connection with its content.