Project Leader

Dr.-Ing. Cristobal Curio
Phone: +49 7121 271 4005
Cognitive Systems at Opens external link in new windowReutlingen University


Group members

CE Overview Poster


04/11/2013 New HMI detectability concept supporting situational awareness featured in IEEE Opens external link in new windowIntelligent Transportation Systems Magazine.
27/09/2013 Computational perception article on view-dependencies of social interaction understanding Opens external link in new windowFrontiers Perception.
26/08/2013 Congratulations to Christian Herdtweck on his successful PhD defense!
29/06/2013 Our approach on Opens external link in new window3D driver head pose monitoring will be presented at Opens external link in new windowTP.CG.2013 conference at Eurographics UK.
24/06/2013 Our cognitive vision architecture on efficient monocular car viewpoint estimation [Opens external link in new windowpdf] has been presented at the Opens external link in new windowIntelligent Vehicles conference.
10/06/2013 We participated in Opens external link in new windowEU-FET-Open (Future and Emerging Technologies) project TANGO. The project has been evaluated as excellent.
20/01/2013  Visual cues determining emotional dynamic facial expression recognition (Opens external link in new windowJournal of Vision)
13/09/2012 Opens external link in new windowBest Conference Paper Award at Opens external link in new windowIEEE conference on Multisensor Fusion and Information Integration (MFI) 2012.
06/03/2012  Enhancing drivers' environment perception presented as Opens external link in new windowtalk (best paper finalist) and novel monocular visual odometry approach at Intelligent Vehicles conference.
05/10/2011 Public release of medial feature grouping and superpixel segmentation Opens external link in new windowcode.
09/ 2011 HMI system for image retrieval presented at INTERACT 2011 conference.
03/2011 Paper presentation at IEEE Automatic Face & Gesture Conference, Santa Barbara. Watch our latest facial analysis video with the Microsoft Kinect sensor on youtube.
10/2010 Our book on Dynamic Faces: Insights from Experiments and Computation has appeared at MIT press.
10/2010 Two SIGGRAPH Asia 2010 Technical Sketches accepted for presentation.
05/2010 Paper at CVPR Conference Workshop on Feature Grouping.
09/2009 We won a DAGM paper prize for work on automatic 3D surface tracking for the generation of a 4D morphable face model. Conference of the German Association for Pattern Recognition (DAGM).


WS 2012/13 Opens external link in new windowMedizinische Bildverarbeitung at the Computer Science Department, Tübingen.
SS 2012 Opens external link in new windowMachine Learning II at the Graduate School of Neural Information Processing, Tübingen.
WS 2010/11 Statistical Methods in Artificial Intelligence at the Computer Science Department, Tübingen.
WS 2009/10 Advanced Topics in Machine Learning at the Computer Science Department, Tübingen.

External activities

Opens external link in new windowKI-2013 From Research to Innovation and Practical Applications (Program Committee)
Opens external link in new windowIntelligent Vehicles 2013 PC Associate Editor
WIAF-2012 Workshop Opens external link in new windowWhat's in a face? at ECCV, technical PC.
Associate Editor
06/2011 Organization of workshop on interactive pedestrian behavior analysis and synthesis at IEEE sponsored Intelligent Vehicles, Baden-Baden, June 5, Final program.
 PC at 1st IEEE workshop on Information Theory in Computer Vision and Pattern Recognition at ICCV 2011
Program Committee
Area Chair
COSYNE conference workshop


Opens external link in new windowCenter for Integrated Neuroscience, Section Computational Motorics (Prof. Dr. M.A. Giese)
Opens external link in new windowAutonomous Systems Lab ETHZ (Prof. Dr. R. Siegwart)
Opens external link in new windowZentrum für Neurowissenschaften Zürich (Prof. Dr. med. A. Luft)
Opens external link in new windowMPI for Intelligent Systems (Prof. M. Black)

Five most recent Publications

Herdtweck C and Wallraven C (December-2013) Estimation of the Horizon in Photographed Outdoor Scenes by Human and Machine PLoS ONE 8(12) 1-14.
Dobricki M and de la Rosa S (December-2013) The structure of conscious bodily self-perception during full-body illusions PLoS ONE 8(12) 1-9.
Dobs K, Schultz J, Bülthoff I and Gardner JL (November-10-2013): Attending to expression or identity of dynamic faces engages different cortical areas, 43rd Annual Meeting of the Society for Neuroscience (Neuroscience 2013), San Diego, CA, USA.
Nieuwenhuizen FM, Chuang LL and Bülthoff HH (November-2013) myCopter: Enabling Technologies for Personal Aerial Transportation Systems: Project status after 2.5 years5. Internationale HELI World Konferenz "HELICOPTER Technologies", "HELICOPTER Operations" at the International Aerospace Supply Fair AIRTEC 2013, Airtec GmbH, Frankfurt a. Main, Germany, 1-3.
Bieg H-J (October-1-2013) Abstract Talk: Oculomotor Decisions: Saccadic or Smooth Response?, 14th Conference of Junior Neuroscientists of Tübingen (NeNa 2013), Schramberg, Germany 19.

Export as:
BibTeX, XML, Pubman, Edoc, RTF


Cognitive Engineering

Interfacing different disciplines for the development and optimization of human-centered interactive applications.
The Cognitive Engineering group develops applications based on Computer-Vision, Machine-Learning and Computer-Graphics in combination with methods that model Human cognitive processes. Highly controllable and realistic settings, real-world sensor data and simulations, offer the opportunity for advanced experiments and at the same time a framework to design and optimize processes in Human-Machine-Interfaces. Our approach ultimately opens a new window to modern industries such as entertainment computing (games), communication research (information transfer, multimedia), medical systems, and personal assistance systems (automotive safety).
For example, we develop realistic computer-generated models that offer as research tool new opportunities to study human cognitive processes in interactive situations. Results from such experiments are in turn used to build effective Human-Machine-Interfaces. We mainly develop and employ Computer-Vision and Machine-Learning algorithms to quantify human performance in natural interactive situations. The results from perception experiments provide constraints for designing artificial vision algorithms and thus lead to more efficient approaches in, for example, artificial environment understanding. Realistic virtual worlds and animations, generated with Computer-Graphics, support us with "ground truth" to prototype artificial recognition algorithms and to determine the critical factors in human decision making. The semantic modeling of high-dimensional data spaces is another important goal of our work. It provides the basis to effectively study and optimize Human-Computer interaction.

Main research areas

Applied Computer Vision
We develop Computer Vision systems that can enhance and support the visual perception and decision making processes of humans. The components we investigate range from low-level image features to high level system components for, e.g., autonomous navigation or artificial scene interpretation.
Adaptive Human-Machine-Interfaces
We combine Computer Vision, Machine Learning and Computer Graphics with experimental methods of Cognitive Sciences in order to optimize technical interfaces between human and machine perception.
Automatic Movement Reconstruction Technologies
Rich movement models, for example dynamic morphable face models, have a large impact on the fields of computer vision, behavior monitoring, as well as computer graphics and animation. Attributes such as descriptiveness, semantics, and intuitive control are desirable properties. For robust applications we build models from high-quality and noisy depth data such as that produced by Time-of-Flight (ToF) cameras or devices such as Microsoft Kinect.
Signal Processing of Social Interactions
We can best understand human behavior in natural interactions. For example, we have developed a real-time facial expression control system. Major technological challenges are in general the reduction of noticeable feedback latencies without loosing accuracy. The inclusion of body motion capture allows to create animatable humans. Learning generative models of interactions is another important goal in order to understand complex behavior. Moreover, we want to understand the visual perception of social crowds, which in return will benefit the development of artificial vision systems in order to make complex predictions.

Selected publications

Engel D and Curio C (October-2013) Detectability Prediction for Increased Scene Awareness IEEE Intelligent Transportation Systems Magazine 5(4) 146-157.
Herdtweck C and Curio C (June-2013) Monocular Car Viewpoint Estimation with Circular Regression ForestsIEEE Intelligent Vehicles Symposium (IV 2013), IEEE, Piscataway, NJ, USA, 403-410.
de la Rosa S, Giese MA, Bülthoff HH and Curio C (January-2013) The contribution of different cues of facial movement to the emotional facial expression adaptation aftereffect Journal of Vision 13(1:23) 1-15.
Engel D, Herdtweck C, Browatzki B and Curio C (September-2011) Image Retrieval with Semantic Sketches, Series: Lecture Notes in Computer Science ; 6946 In: Human-Computer Interaction: INTERACT 2011, 13th IFIP TC13 Conference on Human-Computer Interaction, Springer, Berlin, Germany, 412-425.
Breidt M, Bülthoff HH and Curio C (March-2011) Robust Semantic Analysis by Synthesis of 3D Facial MotionNinth IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE, Piscataway, NJ, USA, 713-719.
Breidt M, Bülthoff HH and Curio C (December-2010) Face Models from Noisy 3D Cameras3rd ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2010), ACM Press, New York, NY, USA, 1-2.
Walder C, Breidt M, Bülthoff HH, Schölkopf B and Curio C (September-2009) Markerless 3D Face Tracking (DAGM 2009) In: Pattern Recognition, 31. Symposium of the German Association for Pattern Recognition (DAGM 2009), Springer, Berlin, Germany, 41-50.
Curio C and Giese M (January-2005) Combining View-based and Model-based Tracking of Articulated Human MovementsIEEE Computer Society Workshop on Motion and Vision Computing (MOTION 2005), IEEE Computer Society, Los Alamitos, CA, USA, 261-268.
Bücher T, Curio C, Edelbrunner J, Igel C, Kastrup D, Leefken I, Lorenz G, Steinhage A and von Seelen W (February-2003) Image Processing and Behaviour Planning for Intelligent Vehicles IEEE Transactions on Industrial Electronics 90(1) 62-75.

Export as:
BibTeX, XML, Pubman, Edoc, RTF
Last updated: Friday, 10.04.2015