Project Leader

Dr.-Ing. Cristobal Curio
Phone: +49 7121 271 4005
Cognitive Systems at Opens external link in new windowReutlingen University


Group members

CE Overview Poster


04/11/2013 New HMI detectability concept supporting situational awareness featured in IEEE Opens external link in new windowIntelligent Transportation Systems Magazine.
27/09/2013 Computational perception article on view-dependencies of social interaction understanding Opens external link in new windowFrontiers Perception.
26/08/2013 Congratulations to Christian Herdtweck on his successful PhD defense!
29/06/2013 Our approach on Opens external link in new window3D driver head pose monitoring will be presented at Opens external link in new windowTP.CG.2013 conference at Eurographics UK.
24/06/2013 Our cognitive vision architecture on efficient monocular car viewpoint estimation [Opens external link in new windowpdf] has been presented at the Opens external link in new windowIntelligent Vehicles conference.
10/06/2013 We participated in Opens external link in new windowEU-FET-Open (Future and Emerging Technologies) project TANGO. The project has been evaluated as excellent.
20/01/2013  Visual cues determining emotional dynamic facial expression recognition (Opens external link in new windowJournal of Vision)
13/09/2012 Opens external link in new windowBest Conference Paper Award at Opens external link in new windowIEEE conference on Multisensor Fusion and Information Integration (MFI) 2012.
06/03/2012  Enhancing drivers' environment perception presented as Opens external link in new windowtalk (best paper finalist) and novel monocular visual odometry approach at Intelligent Vehicles conference.
05/10/2011 Public release of medial feature grouping and superpixel segmentation Opens external link in new windowcode.
09/ 2011 HMI system for image retrieval presented at INTERACT 2011 conference.
03/2011 Paper presentation at IEEE Automatic Face & Gesture Conference, Santa Barbara. Watch our latest facial analysis video with the Microsoft Kinect sensor on youtube.
10/2010 Our book on Dynamic Faces: Insights from Experiments and Computation has appeared at MIT press.
10/2010 Two SIGGRAPH Asia 2010 Technical Sketches accepted for presentation.
05/2010 Paper at CVPR Conference Workshop on Feature Grouping.
09/2009 We won a DAGM paper prize for work on automatic 3D surface tracking for the generation of a 4D morphable face model. Conference of the German Association for Pattern Recognition (DAGM).


WS 2012/13 Opens external link in new windowMedizinische Bildverarbeitung at the Computer Science Department, Tübingen.
SS 2012 Opens external link in new windowMachine Learning II at the Graduate School of Neural Information Processing, Tübingen.
WS 2010/11 Statistical Methods in Artificial Intelligence at the Computer Science Department, Tübingen.
WS 2009/10 Advanced Topics in Machine Learning at the Computer Science Department, Tübingen.

External activities

Opens external link in new windowKI-2013 From Research to Innovation and Practical Applications (Program Committee)
Opens external link in new windowIntelligent Vehicles 2013 PC Associate Editor
WIAF-2012 Workshop Opens external link in new windowWhat's in a face? at ECCV, technical PC.
Associate Editor
06/2011 Organization of workshop on interactive pedestrian behavior analysis and synthesis at IEEE sponsored Intelligent Vehicles, Baden-Baden, June 5, Final program.
 PC at 1st IEEE workshop on Information Theory in Computer Vision and Pattern Recognition at ICCV 2011
Program Committee
Area Chair
COSYNE conference workshop


Opens external link in new windowCenter for Integrated Neuroscience, Section Computational Motorics (Prof. Dr. M.A. Giese)
Opens external link in new windowAutonomous Systems Lab ETHZ (Prof. Dr. R. Siegwart)
Opens external link in new windowZentrum für Neurowissenschaften Zürich (Prof. Dr. med. A. Luft)
Opens external link in new windowMPI for Intelligent Systems (Prof. M. Black)

Five most recent Publications

Herdtweck C und Wallraven C (Dezember-2013) Estimation of the Horizon in Photographed Outdoor Scenes by Human and Machine PLoS ONE 8(12) 1-14.
Dobricki M und de la Rosa S (Dezember-2013) The structure of conscious bodily self-perception during full-body illusions PLoS ONE 8(12) 1-9.
Dobs K, Schultz J, Bülthoff I und Gardner JL (November-10-2013): Attending to expression or identity of dynamic faces engages different cortical areas, 43rd Annual Meeting of the Society for Neuroscience (Neuroscience 2013), San Diego, CA, USA.
Nieuwenhuizen FM, Chuang LL und Bülthoff HH (November-2013) myCopter: Enabling Technologies for Personal Aerial Transportation Systems: Project status after 2.5 years, 5. Internationale HELI World Konferenz "HELICOPTER Technologies", "HELICOPTER Operations" at the International Aerospace Supply Fair AIRTEC 2013, Airtec GmbH, Frankfurt a. Main, Germany, 1-3.
Bieg H-J (Oktober-1-2013) Abstract Talk: Oculomotor Decisions: Saccadic or Smooth Response?, 14th Conference of Junior Neuroscientists of Tübingen (NeNa 2013): Do the Results, Justify the Methods, Schramberg, Germany 19.

Export als:
BibTeX, XML, pubman, Edoc, RTF


Integration of Machine-Vision, Perception and Virtual Realilties

Interfacing Human and Machine Environment Perception

This research opens a new window to novel design paradigms for the optimization of Human-Machine interfaces, i.e. in the context of driver assistance functionalities in time critical decision situations. With our methodology we gain also further insights into the cognitive mechanisms that guide human attention in real-world closed-loop dynamic situations, such as driving.
For example, a driver assistance system realizes that the driver is distracted and that a potentially hazardous situation is emerging. Where should it guide the attention of the driver? Optimally to the spot that allows the driver to make the best decision. Pedestrian detectability has been proposed recently by us as a measure of the probability that a driver perceives pedestrians in an image. Leveraging this information allows a driver assistance system to direct the attention of the driver to the spot that maximizes the probability that all pedestrians are seen.
We have shown that this concept applies to natural dynamic driving scenes. We were able to establish a complex mapping to predict the optimal focus of attention in hazardous contexts, thus demonstrating the usefulness of our method.
Engel D Person and Curio C Person (June-2013) Detectability Prediction for Increased Scene Awareness  IEEE Intelligent Transportation Systems Magazine 5(4) 146-157.
Engel D Person and Curio C Person (2012) Detectability Prediction in Dynamic Scenes for Enhanced Environment Perception IEEE Intelligent Vehicles Symposium (IV 2012), Best paper finalist.
Engel D Person and Curio C Person (2011) Pedestrian Detectability: Predicting Human Perception Performance with Machine Vision IEEE Intelligent Vehicles Symposium (IV 2011), 1-7. 

Novel Image Retrieval Interfaces with Semantic Sketches

Engel et al 2011
With increasingly large image databases, searching in them becomes an ever more difficult endeavor. Consequently, there is a need for advanced tools for image retrieval in a webscale context. Searching by tags becomes intractable in such scenarios as large numbers of images will correspond to queries such as “car and house and street”. We present a novel approach that allows a user to search for images based on semantic sketches that describe the desired composition of the image. Our system operates on images with labels for a few high-level object categories, allowing us to search very fast with a minimal memory footprint. We employ a structure similar to random decision forests which avails a data-driven partitioning of the image space providing a search in logarithmic time with respect to the number of images. This makes our system applicable for large scale image search problems. We performed a user study that demonstrates the validity and usability of our approach.
Engel D PersonBrowatzki B PersonHerdtweck C Person and Curio C Person (2011) Image Retrieval with Semantic Sketches , 13th IFIP TC13 Conference on Human-Computer Interaction (INTERACT 2011).

Perceptually optimized Redirected Walking Controller

Engel et al 2009
Experience indicates that the sense of presence in a virtual environment is enhanced when user are able to actively move through it. When exploring a virtual world by walking, the size of the model is usually limited by the size of the available tracking space. A promising way to overcome these limitations are motion compression techniques, which decouple the position in the real and virtual world by introducing imperceptible visual-proprioceptive conflicts. Such techniques usually precalculate the redirection factors, greatly reducing their robustness. Our group has developed a novel approach to determine instantaneously rotational gains by developing a feedback controller to on-line manipulate visual feedback. We present a psychophysical study that measures the sensitivity of visual-proprioceptive conflicts during walking and use this to calibrate the parameters of the controller. We have demonstrated the validity of our approach by allowing users to walk through VEs vastly larger than their space they can be physically tracked within. Experiments were carried out using motion tracking and head-mounted display technology installed in the Cyberneum facility.

Engel D Person
Curio C PersonTcheang L PersonMohler B Person and Bülthoff HH Person (2008) A psychophysically calibrated controller for navigating through large environments in a limited free-walking space 15th ACM Symposium on Virtual Reality Software and Technology (VRST 2008), ACM Press, New York, NY, USA, 157-164. 


Engel D und Curio C (Oktober-2013) Detectability Prediction for Increased Scene Awareness IEEE Intelligent Transportation Systems Magazine 5(4) 146-157.
CiteID: EngelC2013
Engel D und Curio C (Juni-2012) Detectability prediction in dynamic scenes for enhanced environment perception, IEEE Intelligent Vehicles Symposium (IV 2012), IEEE, Piscataway, NJ, USA, 178-183.
pdfCiteID: EngelC2012
Herdtweck C und Curio C (Juni-2012) Experts of probabilistic flow subspaces for robust monocular odometry in urban areas, IEEE Intelligent Vehicles Symposium (IV 2012), IEEE, Piscataway, NJ, USA, 661-667.
pdfCiteID: HerdtweckC2012
Layher G, Tschechne S, Scherer S, Brosch T, Curio C und Neumann H (Oktober-2011) Social Signal Processing in Companion Systems: Challenges Ahead In: Informatik 2011: Informatik schafft Communities, , Workshop on "Companion-Systeme und Mensch-Companion-Interaktion", Gesellschaft für Informatik, Bonn, Germany, 239, Series: Lecture Notes in Informatics.
pdfCiteID: LayherTSBCN2011
Engel D, Herdtweck C, Browatzki B und Curio C (September-2011) Image Retrieval with Semantic Sketches In: Human-Computer Interaction: INTERACT 2011, , 13th IFIP TC13 Conference on Human-Computer Interaction, Springer, Berlin, Germany, 412-425, Series: Lecture Notes in Computer Science ; 6946.
CiteID: EngelBHC2011
Engel D und Curio C (Juni-2011) Pedestrian Detectability: Predicting Human Perception Performance with Machine Vision, IEEE Intelligent Vehicles Symposium (IV 2011), IEEE, Piscataway, NJ, USA, 429-435.
pdfCiteID: EngelC2011_2
Engel D, Curio C, Tcheang L, Mohler B und Bülthoff HH (Oktober-2008) A psychophysically calibrated controller for navigating through large environments in a limited free-walking space, 15th ACM Symposium on Virtual Reality Software and Technology (VRST 2008), ACM Press, New York, NY, USA, 157-164.
pdfCiteID: 5323

Export als:
BibTeX, XML, pubman, Edoc, RTF
Last updated: Freitag, 10.04.2015