Consortium overview

  • Computer vision & audio processing researchers
    • Multitel asbl (MULT), Belgium (Coordinator)
    • Idiap Research Institute (IDIAP), Switzerland
    • Institut National de Recherche en Informatique et Automatique (INRIA), France
    • Thales Communications France (TCF), France

  • Surveillance system designer
    • Thales Italia (THALIT), Italy

  • Public transport operators (metros)
    • Gruppo Torinese Trasporti (GTT), Italy
    • Régie Autonome des Transports Parisiens (RATP), France

  • Human ethologists (sociologist)
    • University of Vienna (UNIVIE), Austria

Project coordinator

Since 1999, Multitel asbl (MULT) acquired a statute of research centre in the form of a non-profit organization with the long-term goal of being capable to be self-financing. The R&D domains of MULT are: Optical Telecommunications, Access Networks, Public and private Intranets, Signal and Image Processing, Data Fusion, Sound and Image coding (visual surveillance), Speech Technologies (Speech Synthesis, speaker and Speech recognition).

As principal investigator and project coordinator, MULT is in charge of the management aspects of the project. Moreover, since the key competence of MULT is the video analysis and features extraction, MULT is also involved in the related tasks. Last, as coordinator, MULT is actively involved in the dissemination activities.

For more information

        • contact Dr. C. Carincotte at carincotte at multitel dot be
        • or refer to


Gruppo Torinese Trasporti (GTT) was created from the merger of ATM (urban Turin mobility company) and SATTI (regional Turin mobility company) January 1st, 2003. The company transports 190 million passengers per year, has a staff of approximately 5,240 people, and realizes an annual turnover of €356 million.

As project end-user, GTT is in charge of defining the type of use-case scenario and the user needs that are essential for the specification of the technological components. The key asset of GTT is to provide a real user test bed in the metro of Turin, to evaluate the technologies developed within VANAHEIM. GTT is strongly involved in the data collection stages, in the component evaluations, and in user trials and demonstrations.

For more information

The Institut Dalle Molle d'Intelligence Artificielle Perceptive (IDIAP) Research Institute is an independent, non-profit research organization located in Martigny, Switzerland, affiliated with the Ecole Polytechnique Fédérale de Lausanne (EPFL) and the University of Geneva. IDIAP conducts R\&D in the areas of Speech Processing, Computer Vision, Machine Learning, Multimodal Interaction, Information Retrieval, and Biometric Authentication, with a total staff of 80 people.

IDIAP is leading and mainly contributing to the camera selection, and to the low-level non-verbal cue extraction. In particular, IDIAP brings its expertise in three main domains: the modelling of visual documents using text-based approaches and graphical models; the estimation of head poses from visual data, and the multi-object tracking and interaction modelling.

For more information

        • contact Dr. J.M. Odobez at odobez at idiap dot ch
        • or refer to

INRIA (National Institute for Research in Computer Science and Control) is a French public sector scientific and technological institute operating under the dual authority of the Ministry of Research and the Ministry of Industry. INRIA's missions are "to undertake basic and applied research, to design experimental systems, to ensure technology and knowledge transfer, to organize international scientific exchanges, to carry out scientific assessments, and to contribute to standardization".

In VANAHEIM, INRIA's research group (Pulsar) is involved in the investigation of human-interactions/behaviours perception and learning by the system; INRIA is studying multi-modal behavioral audio/video scene understanding algorithms, and is designing a new framework to endow monitoring systems with capabilities for learning behaviour and human interaction models.

For more information

        • contact Dr. F. Bremond at francois.bremond at sophia.inria dot fr
        • or refer to

Created on 1949, Régie Autonome des Transports Parisiens (RATP) is one of the largest multimodal transport property in the world, as it operates 16 Metro lines (among which the fully automated METEOR line n° 14), 2 commuter lines (RER: Express Regional Network), 3 tramway lines and 340 bus lines in an area that covers 178 suburban towns with a total population of 11 millions inhabitants. RATP serves also the two main Paris airports with Roissybus, Orlybus, and the Orlyval fully automated shuttle. 45 000 men and women provide a public service for the 10,2 million travels made daily on the RER, metro, tramways and buses, which amounts to a total of over 2,8 billion travels in 2007.

RATP is, together with GTT, in charge of defining the type of use-case scenario and the user needs that are needed for the specification of the technological components. The key asset of RATP is to provide a second complementary test bed in the metro of Paris (BFM metro station) to evaluate the technologies developed within VANAHEIM.

For more information

Thales Communications France (TCF) is a subsidiary of the Thales group and is part of its Communications Business Group. TCF is a world leader in its domain of activity covering communications networks, satellite communications, mobile radio-communications, naval & infrastructure communication systems, airborne communication, navigation and identification systems both for civil and military aircrafts, command information systems, radio-surveillance systems and radio spectrum monitoring.

TCF leads the unsupervised selection of heterogeneous sensors work package. In addition, TCF brings its expertise in complex audio and video systems, and contribute to joint audio/video analysis in the compressed domain.

For more information

        • contact Eng. B. Ravera at bertrand.ravera at fr.thalesgroup dot com
        • or refer

Thales Italia (THALIT) encompasses all the businesses of the Thales Group in Italy with the exception of the joint ventures with Finmeccanica (Thales Alenia Space, 67%, Telespazio, 33%, and Elettronica, 33%). Thales Italia (Security and Transportation business domain) has made of the security of critical information systems for governments, operators and industries, one of its key strategic objectives. It has developed in many years a strong experience and internationally recognized excellence in integration projects related to transportation (railways, metro, tramways), airports and critical infrastructure in general, where it integrates technologies and develops state-of-the-art solutions in a continue collaborations with research centers and universities.

THALIT contributes mainly to system requirements specification, architecture and components specification, reference data acquisition system set-up and is one of the main contributor for the system integration and validation work package, coordinating the tasks for the development of the middleware components, API and GUI required for the overall system integration.

For more information

The Human Behavior Research Group at the University of Vienna (UNIVIE) (Faculty of Life Science, Department of Anthropology) focuses on human behavior from an evolutionary viewpoint. The group is part of the Department of Anthropology, University of Vienna.

UNIVIE contributes to VANAHEIM by introducing ethological knowledge about human behaviour. Further UNIVIE provides its expertise about video recording so that the collected data is exploitable. Finally UNIVIE tests the reliability of the system by evaluating whether the meaning the cognitive system attributes to a specific video sequence is correct or not.

For more information