Project Leader

Dr.-Ing. Cristobal Curio
Phone: +49 7071 601-605
Fax: +49 7071 601-616
cristobal.curio[at]tuebingen.mpg.de
 

People

Group members
 

CE Overview Poster


News

20/02/2013 New paper on monocular circular car viewpoint estimation will be presented at Opens external link in new windowIntelligent Vehicles (June 2013)
 
20/01/2013  Visual cues determining emotional dynamic facial expression recognition (Opens external link in new windowJournal of Vision)
 
13/09/2012 Opens external link in new windowBest Conference Paper Award at Opens external link in new windowIEEE conference on Multisensor Fusion and Information Integration (MFI) 2012.

06/03/2012
  Novel HMI approach for enhancing drivers' environment perception (Opens external link in new windowtalk, runner-up for best paper) and novel monocular visual odometry approach at Intelligent Vehicles conference.

05/10/2011 Public release of medial feature grouping and superpixel segmentation Opens external link in new windowcode.


09/ 2011
 HMI system for image retrieval presented at INTERACT 2011 conference.

06/ 2011
Automotive HMI approach at Intelligent Vehicles 2011.

03/2011
 Paper presentation at IEEE Automatic Face & Gesture Conference, Santa Barbara. Watch our latest facial analysis video with the Microsoft Kinect sensor on youtube.

10/2010
Book on Dynamic Faces, MIT Press has appeared.

10/2010
Two SIGGRAPH Asia 2010 Technical Sketches accepted for presentation.

05/2010
Paper at CVPR Conference Workshop on Feature Grouping.

03/2010
 New EU-FET-Open (Future and Emerging Technologies) project TANGO 'Emotional interaction grounded in realistic context'.

09/2009
Runner up DAGM prize for work on automatic 3D surface tracking for the generation of a 4D morphable face model. Conference of the German Association for Pattern Recognition (DAGM).

Teaching

WS 2012/13 Opens external link in new windowMedizinische Bildverarbeitung at the Computer Science Department, Tübingen.
SS 2012 Opens external link in new windowMachine Learning II at the Graduate School of Neural Information Processing, Tübingen.
WS 2010/11 Statistical Methods in Artificial Intelligence at the Computer Science Department, Tübingen.
WS 2009/10 Advanced Topics in Machine Learning at the Computer Science Department, Tübingen.

External activities

Opens external link in new windowKI-2013 From Research to Innovation and Practical Applications (Program Committee)
Opens external link in new windowIntelligent Vehicles 2013 PC Associate Editor
WIAF-2012 Workshop Opens external link in new windowWhat's in a face? at ECCV, technical PC.
KI-2012
Associate Editor
06/2011 Organization of workshop on interactive pedestrian behavior analysis and synthesis at IEEE sponsored Intelligent Vehicles, Baden-Baden, June 5, Final program.
11/2011
 PC at 1st IEEE workshop on Information Theory in Computer Vision and Pattern Recognition at ICCV 2011
KI-2011
Program Committee
KI-2010
Area Chair
03/2008
COSYNE conference workshop

Collaborators

Opens external link in new windowCenter for Integrated Neuroscience, Section Computational Motorics (Prof. Dr. M.A. Giese)
Opens external link in new windowAutonomous Systems Lab ETHZ (Prof. Dr. R. Siegwart)
Opens external link in new windowZentrum für Neurowissenschaften Zürich (Prof. Dr. med. A. Luft)
Opens external link in new windowMPI for Intelligent Systems (Prof. M. Black)

Five most recent Publications

Chuang LL Person, Nieuwenhuizen FM Person und Bülftoff HH Person (July-2013) A Fixed-Based Flight Simulator Study: The Interdependence of Flight Control Performance and Gaze Efficiency 15th International Conference on Human-Computer Interaction (HCI International 2013), 1-10. akzeptiert
pdf
Herdtweck C Person und Curio C Person (June-2013) Monocular Car Viewpoint Estimation with Circular Regression Forests IEEE Intelligent Vehicles Symposium (IV 2013), IEEE, Piscataway, NJ, USA, 1-8. akzeptiert
de la Rosa S Person, Streuber S Person, Giese M Person, Bülthoff HH Person und Curio C Person (May-11-2013) Abstract Talk: Visual adaptation aftereffects to actions are modulated by high-level action interpretations, 13th Annual Meeting of the Vision Sciences Society (VSS 2013), Naples, FL, USA.
Bonev B , Chuang LL Person und Escolano F (May-2013) How do image complexity, task demands and looking biases influence human gaze behavior? Pattern Recognition Letters 34(7) 723–730.
de la Rosa S Person und Bülthoff HH Person (May-2013) Motor-visual neurons and action recognition in social interactions. Commentary on Mirror neurons: From origin to function Behavioral and Brain Sciences . akzeptiert

Export als:
BibTeX, XML, pubman, Edoc

 

Integration of Machine-Vision, Perception and Virtual Realilties

Interfacing Human and Machine Environment Perception

This research opens a new window to novel design paradigms for the optimization of Human-Machine interfaces, i.e. in the context of driver assistance functionalities in time critical decision situations. With our methodology we gain also further insights into the cognitive mechanisms that guide human attention in real-world closed-loop dynamic situations, such as driving.
For example, a driver assistance system realizes that the driver is distracted and that a potentially hazardous situation is emerging. Where should it guide the attention of the driver? Optimally to the spot that allows the driver to make the best decision. Pedestrian detectability has been proposed recently by us as a measure of the probability that a driver perceives pedestrians in an image. Leveraging this information allows a driver assistance system to direct the attention of the driver to the spot that maximizes the probability that all pedestrians are seen.
We have shown that this concept applies to natural dynamic driving scenes. We were able to establish a complex mapping to predict the optimal focus of attention in hazardous contexts, thus demonstrating the usefulness of our method.

Engel D Person 
and Curio C Person (2012) Detectability Prediction in Dynamic Scenes for Enhanced Environment Perception IEEE Intelligent Vehicles Symposium (IV 2012), Best Paper nominee.
Engel D Person and Curio C Person (2011) Pedestrian Detectability: Predicting Human Perception Performance with Machine Vision IEEE Intelligent Vehicles Symposium (IV 2011), 1-7. 
 

Novel Image Retrieval Interfaces with Semantic Sketches

Engel et al 2011
With increasingly large image databases, searching in them becomes an ever more difficult endeavor. Consequently, there is a need for advanced tools for image retrieval in a webscale context. Searching by tags becomes intractable in such scenarios as large numbers of images will correspond to queries such as “car and house and street”. We present a novel approach that allows a user to search for images based on semantic sketches that describe the desired composition of the image. Our system operates on images with labels for a few high-level object categories, allowing us to search very fast with a minimal memory footprint. We employ a structure similar to random decision forests which avails a data-driven partitioning of the image space providing a search in logarithmic time with respect to the number of images. This makes our system applicable for large scale image search problems. We performed a user study that demonstrates the validity and usability of our approach.
 
Engel D PersonBrowatzki B PersonHerdtweck C Person and Curio C Person (2011) Image Retrieval with Semantic Sketches , 13th IFIP TC13 Conference on Human-Computer Interaction (INTERACT 2011).

Perceptually optimized Redirected Walking Controller

Engel et al 2009
Experience indicates that the sense of presence in a virtual environment is enhanced when user are able to actively move through it. When exploring a virtual world by walking, the size of the model is usually limited by the size of the available tracking space. A promising way to overcome these limitations are motion compression techniques, which decouple the position in the real and virtual world by introducing imperceptible visual-proprioceptive conflicts. Such techniques usually precalculate the redirection factors, greatly reducing their robustness. Our group has developed a novel approach to determine instantaneously rotational gains by developing a feedback controller to on-line manipulate visual feedback. We present a psychophysical study that measures the sensitivity of visual-proprioceptive conflicts during walking and use this to calibrate the parameters of the controller. We have demonstrated the validity of our approach by allowing users to walk through VEs vastly larger than their space they can be physically tracked within. Experiments were carried out using motion tracking and head-mounted display technology installed in the Cyberneum facility.

Engel D Person
Curio C PersonTcheang L PersonMohler B Person and Bülthoff HH Person (2008) A psychophysically calibrated controller for navigating through large environments in a limited free-walking space 15th ACM Symposium on Virtual Reality Software and Technology (VRST 2008), ACM Press, New York, NY, USA, 157-164. 

Publications

Engel D Person und Curio C Person (June-2012) Detectability prediction in dynamic scenes for enhanced environment perception IEEE Intelligent Vehicles Symposium (IV 2012), IEEE, Piscataway, NJ, USA, 178-183.
pdfCiteID: EngelC2012
Herdtweck C Person und Curio C Person (June-2012) Experts of probabilistic flow subspaces for robust monocular odometry in urban areas IEEE Intelligent Vehicles Symposium (IV 2012), IEEE, Piscataway, NJ, USA, 661-667.
pdfCiteID: HerdtweckC2012
Layher G , Neumann H , Scherer S , Tschechne S , Brosch T und Curio C Person (October-2011) Social Signal Processing in Companion Systems: Challenges Ahead In: Informatik 2011: Informatik schafft Communities, Workshop on "Companion-Systeme und Mensch-Companion-Interaktion", Gesellschaft für Informatik, Bonn, Germany, 239.
pdfCiteID: LayherTSBCN2011
Engel D Person, Herdtweck C Person, Browatzki B Person und Curio C Person (September-2011) Image Retrieval with Semantic Sketches In: Human-Computer Interaction: INTERACT 2011, 13th IFIP TC13 Conference on Human-Computer Interaction, Springer, Berlin, Germany, 412-425.
CiteID: EngelBHC2011
Engel D Person und Curio C Person (June-2011) Pedestrian Detectability: Predicting Human Perception Performance with Machine Vision IEEE Intelligent Vehicles Symposium (IV 2011), IEEE, Piscataway, NJ, USA, 429-435.
pdfCiteID: EngelC2011_2
Engel D Person, Curio C Person, Tcheang L Person, Mohler B Person und Bülthoff HH Person (October-2008) A psychophysically calibrated controller for navigating through large environments in a limited free-walking space 15th ACM Symposium on Virtual Reality Software and Technology (VRST 2008), ACM Press, New York, NY, USA, 157-164.
pdfCiteID: 5323

Export als:
BibTeX, XML, pubman, Edoc
Last updated: Monday, 29.04.2013