Group leader

Dr.-Ing. Cristobal Curio
Phone: +49 7121 271 4005
Cognitive Systems at Opens external link in new windowReutlingen University


Group members

CE Overview Poster


04/11/2013 New HMI detectability concept supporting situational awareness featured in IEEE Opens external link in new windowIntelligent Transportation Systems Magazine.
27/09/2013 Computational perception article on view-dependencies of social interaction understanding Opens external link in new windowFrontiers Perception.
26/08/2013 Congratulations to Christian Herdtweck on his successful PhD defense!
29/06/2013 Our approach on Opens external link in new window3D driver head pose monitoring will be presented at Opens external link in new windowTP.CG.2013 conference at Eurographics UK.
24/06/2013 Our cognitive vision architecture on efficient monocular car viewpoint estimation [Opens external link in new windowpdf] has been presented at the Opens external link in new windowIntelligent Vehicles conference.
10/06/2013 We participated in Opens external link in new windowEU-FET-Open (Future and Emerging Technologies) project TANGO. The project has been evaluated as excellent.
20/01/2013  Visual cues determining emotional dynamic facial expression recognition (Opens external link in new windowJournal of Vision)
13/09/2012 Opens external link in new windowBest Conference Paper Award at Opens external link in new windowIEEE conference on Multisensor Fusion and Information Integration (MFI) 2012.
06/03/2012  Enhancing drivers' environment perception presented as Opens external link in new windowtalk (best paper finalist) and novel monocular visual odometry approach at Intelligent Vehicles conference.
05/10/2011 Public release of medial feature grouping and superpixel segmentation Opens external link in new windowcode.
09/ 2011 HMI system for image retrieval presented at INTERACT 2011 conference.
03/2011 Paper presentation at IEEE Automatic Face & Gesture Conference, Santa Barbara. Watch our latest facial analysis video with the Microsoft Kinect sensor on youtube.
10/2010 Our book on Dynamic Faces: Insights from Experiments and Computation has appeared at MIT press.
10/2010 Two SIGGRAPH Asia 2010 Technical Sketches accepted for presentation.
05/2010 Paper at CVPR Conference Workshop on Feature Grouping.
09/2009 We won a DAGM paper prize for work on automatic 3D surface tracking for the generation of a 4D morphable face model. Conference of the German Association for Pattern Recognition (DAGM).


WS 2012/13 Opens external link in new windowMedizinische Bildverarbeitung at the Computer Science Department, Tübingen.
SS 2012 Opens external link in new windowMachine Learning II at the Graduate School of Neural Information Processing, Tübingen.
WS 2010/11 Statistical Methods in Artificial Intelligence at the Computer Science Department, Tübingen.
WS 2009/10 Advanced Topics in Machine Learning at the Computer Science Department, Tübingen.

External activities

Opens external link in new windowKI-2013 From Research to Innovation and Practical Applications (Program Committee)
Opens external link in new windowIntelligent Vehicles 2013 PC Associate Editor
WIAF-2012 Workshop Opens external link in new windowWhat's in a face? at ECCV, technical PC.
Associate Editor
06/2011 Organization of workshop on interactive pedestrian behavior analysis and synthesis at IEEE sponsored Intelligent Vehicles, Baden-Baden, June 5, Final program.
 PC at 1st IEEE workshop on Information Theory in Computer Vision and Pattern Recognition at ICCV 2011
Program Committee
Area Chair
COSYNE conference workshop


Opens external link in new windowCenter for Integrated Neuroscience, Section Computational Motorics (Prof. Dr. M.A. Giese)
Opens external link in new windowAutonomous Systems Lab ETHZ (Prof. Dr. R. Siegwart)
Opens external link in new windowZentrum für Neurowissenschaften Zürich (Prof. Dr. med. A. Luft)
Opens external link in new windowMPI for Intelligent Systems (Prof. M. Black)

Five most recent Publications

Herdtweck C and Wallraven C (December-2013) Estimation of the Horizon in Photographed Outdoor Scenes by Human and Machine PLoS ONE 8(12) 1-14.
Dobricki M and de la Rosa S (December-2013) The structure of conscious bodily self-perception during full-body illusions PLoS ONE 8(12) 1-9.
Dobs K, Schultz J, Bülthoff I and Gardner JL (November-10-2013): Attending to expression or identity of dynamic faces engages different cortical areas, 43rd Annual Meeting of the Society for Neuroscience (Neuroscience 2013), San Diego, CA, USA.
Nieuwenhuizen FM, Chuang LL and Bülthoff HH (November-2013) myCopter: Enabling Technologies for Personal Aerial Transportation Systems: Project status after 2.5 years, 5. Internationale HELI World Konferenz "HELICOPTER Technologies", "HELICOPTER Operations" at the International Aerospace Supply Fair AIRTEC 2013, Airtec GmbH, Frankfurt a. Main, Germany, 1-3.
Bieg H-J (October-1-2013) Abstract Talk: Oculomotor Decisions: Saccadic or Smooth Response?, 14th Conference of Junior Neuroscientists of Tübingen (NeNa 2013): Do the Results, Justify the Methods, Schramberg, Germany 19.

Export as:
BibTeX, XML, Pubman, Edoc, RTF


Towards Models of Interactive Pedestrian Behavior for Intelligent Vehicles

Workshop at the Annual IEEE sponsored International Symposium on Intelligent Vehicles

Baden-Baden 2011 (5-9 June), Germany

Workshop date: Sunday, June 5, full day

Organizer:   C. Curio, Max Planck Institute for Biological Cybernetics, Tübingen, Germany


Current driver assistance systems support the visual recognition of pedestrians in dynamic visual scenes, typically based on the detection of static and dynamic cues of individual persons. The integration of knowledge about more complex interactions between groups of humans into such systems is still a challenge but is necessary to enhance perception and decision making processes. This workshop presents interdisciplinary research and developments on human collective behavior analysis and synthesis, ranging from motion-capturing, graphical simulation for prototyping and experiments, machine-vision for detection and prediction, to robotics for safe navigation in crowded urban areas. Novel approaches at the interface of different disciplines with similar aims are contributing to a better understanding of human crowd behavior with the hope to ultimately lead to even more purposeful human-centered assistance systems. At the core of these approaches are generative models learned from real-world data, applied to the simulation of populated scenes and machine vision. The goal of this workshop is to give an overview and stimulate research and developments in this field ultimately leading to assistance systems that can take complex behavior of pedestrians in street scenes into account.

Human Crowd Perception, Environment Simulation, Pedestrian Detection and Tracking, Motion Capture, Models of Social Interaction, Intention Modelling, Dynamic Models, Social Robotics, Animation, Virtual Reality, Prototyping.



Julien Pettre, INRIA-Rennes, France, Martin A. Giese, Computational Sensomotorics, University Clinic, Tübingen, Germany, Luc van Gool, Computer Vision Laboratory, ETH Zürich, Switzerland, Kai O. Arras, Social Robotics Laboratory, Freiburg, Germany, Bernt Schiele, Max Planck Institute Informatics, Saarbrücken, Germany, Dariu Gavrila, Department of Environment Perception, Daimler Research & Development, Ulm, Germany, Christian Laugier, INRIA-Rhone-Alpes, Grenoble, France.



Crowd Simulation and Movement Representation

9:00-9:45 Dr. Julien Pettre


“Crowd Simulation for Interactive Virtual Environments”

Crowd simulation is a difficult problem. It is even more challenging in the context of interactive applications where computation time is strictly limited. Trade-offs between quality and performance are required to fit a simulation to interactive contexts. We discuss the various approaches to tune such trade-off and evaluate them.


10:00-10:45 Prof. Dr. Martin A. Giese

Computational Sensomotorics, University Clinic, Tübingen/Germany

“Synthesis of Body Movements Based on Learned Dynamic Primitives”

We present a method for the learning of generative models of individual and collective human behavior based on motion capture, exploiting a combination of unsupervised learning and nonlinear dynamics. Specifically, we show how stability constraints for coordinated collective behavior of groups of agents can be derived for such systems.

Social Interaction Models for Detection, Tracking and Prediction

11:00-11:45 Prof. Dr. Luc van Gool

Computer Vision Laboratory, ETH Zürich/Switzerland

“Crowd sorcering: trying to understand crowd flows”

We concisely discuss our work to track people in crowds. One possible improvement is the use of stronger models for their expected motions. We focus on a model that takes account of social influences when people move in crowds.


12:00-12:45 Prof. Dr. Kai O. Arras

Social Robotics Laboratory, Freiburg/Germany

“Range-Based People Detection and Tracking for Socially Aware Intelligent Vehicles”

We will present our line of work in detection and tracking of people and groups of people in 2D and 3D range data that combine tracking with learned or a priori given models of human activities and social behavior. This combination is shown to lead to improved tracking accuracy. We will also present very recent advances in people detection in dense 3D data.


13:00-14:15 Lunch break

Environment Perception and Path Planning


14:15-15:00 Prof. Dr. Bernt Schiele

Max Planck Institute Informatics, Saarbrücken/Germany

“Articulated Body Models and 3D Scene Models for Detection, Tracking and Prediction”
Work on articulated models has let to better detection and tracking results. Including 3D scene models can further improve performance but also enable better “understanding” of the environment.


15:15-16:00 Prof. Dr. Dariu Gavrila

Dept. of Environment Perception, Daimler Research and Development, Ulm/Germany

“From Detecting to Understanding Pedestrians”

General overview and Daimler activities.


16:15-17:00  Prof. Dr. Christian Laugier

INRIA-Rhone-Alpes, Grenoble/France

“Collision Risk Assessment and Application to a Risk based Navigation System”

This talk covers aspects of modeling mobile obstacle behaviors (vehicles, pedestrians), motion prediction for potential mobile obstacles, probabilistic collision risk assessment, risk based navigation decisions using incomplete task models and perception.


Panel discussion


17:15 - 17:30

This workshop is supported by EU-Project TANGO
Last updated: Friday, 23.02.2018