Event Calendar:

May 2013
Mo Tu We Th Fr Sa Su
18 29 30 01 02 03 04 05
19 06 07 08 09 10 11 12
20 13 14 15 16 17 18 19
21 20 21 22 23 24 25 26
22 27 28 29 30 31 01 02

» All Events

Quick Links

Project Leader

Dr.-Ing. Cristobal Curio
Phone: +49 7071 601-605
Fax: +49 7071 601-616
cristobal.curio[at]tuebingen.mpg.de
 

People

Group members
 

CE Overview Poster


News

20/02/2013 New paper on monocular circular car viewpoint estimation will be presented at Opens external link in new windowIntelligent Vehicles (June 2013)
 
20/01/2013  Visual cues determining emotional dynamic facial expression recognition (Opens external link in new windowJournal of Vision)
 
13/09/2012 Opens external link in new windowBest Conference Paper Award at Opens external link in new windowIEEE conference on Multisensor Fusion and Information Integration (MFI) 2012.

06/03/2012  Novel HMI approach for enhancing drivers' environment perception (Opens external link in new windowtalk, runner-up for best paper) and novel monocular visual odometry approach at Intelligent Vehicles conference.

05/10/2011 Public release of medial feature grouping and superpixel segmentation Opens external link in new windowcode.

09/ 2011 HMI system for image retrieval presented at INTERACT 2011 conference.

06/ 2011 Automotive HMI approach at Intelligent Vehicles 2011.

03/2011 Paper presentation at IEEE Automatic Face & Gesture Conference, Santa Barbara. Watch our latest facial analysis video with the Microsoft Kinect sensor on youtube.

10/2010 Book on Dynamic Faces, MIT Press has appeared.

10/2010 Two SIGGRAPH Asia 2010 Technical Sketches accepted for presentation.

05/2010 Paper at CVPR Conference Workshop on Feature Grouping.

03/2010 New EU-FET-Open (Future and Emerging Technologies) project TANGO 'Emotional interaction grounded in realistic context'.

09/2009 Runner up DAGM prize for work on automatic 3D surface tracking for the generation of a 4D morphable face model. Conference of the German Association for Pattern Recognition (DAGM).

Teaching

WS 2012/13 Opens external link in new windowMedizinische Bildverarbeitung at the Computer Science Department, Tübingen.
SS 2012 Opens external link in new windowMachine Learning II at the Graduate School of Neural Information Processing, Tübingen.
WS 2010/11 Statistical Methods in Artificial Intelligence at the Computer Science Department, Tübingen.
WS 2009/10 Advanced Topics in Machine Learning at the Computer Science Department, Tübingen.

External activities

Opens external link in new windowKI-2013 From Research to Innovation and Practical Applications (Program Committee)
Opens external link in new windowIntelligent Vehicles 2013 PC Associate Editor
WIAF-2012 Workshop Opens external link in new windowWhat's in a face? at ECCV, technical PC.
KI-2012 Associate Editor
06/2011 Organization of workshop on interactive pedestrian behavior analysis and synthesis at IEEE sponsored Intelligent Vehicles, Baden-Baden, June 5, Final program.
11/2011 PC at 1st IEEE workshop on Information Theory in Computer Vision and Pattern Recognition at ICCV 2011
KI-2011 Program Committee
KI-2010 Area Chair
03/2008 COSYNE conference workshop

Collaborators

Opens external link in new windowCenter for Integrated Neuroscience, Section Computational Motorics (Prof. Dr. M.A. Giese)
Opens external link in new windowAutonomous Systems Lab ETHZ (Prof. Dr. R. Siegwart)
Opens external link in new windowZentrum für Neurowissenschaften Zürich (Prof. Dr. med. A. Luft)
Opens external link in new windowMPI for Intelligent Systems (Prof. M. Black)

Five most recent Publications

Chuang LL Person, Nieuwenhuizen FM Person and Bülftoff HH Person (July-2013) A Fixed-Based Flight Simulator Study: The Interdependence of Flight Control Performance and Gaze Efficiency 15th International Conference on Human-Computer Interaction (HCI International 2013), 1-10. accepted
 pdf
Herdtweck C Person and Curio C Person (June-2013) Monocular Car Viewpoint Estimation with Circular Regression Forests IEEE Intelligent Vehicles Symposium (IV 2013), IEEE, Piscataway, NJ, USA, 1-8. accepted
de la Rosa S Person, Streuber S Person, Giese M Person, Bülthoff HH Person and Curio C Person (May-11-2013) Abstract Talk: Visual adaptation aftereffects to actions are modulated by high-level action interpretations, 13th Annual Meeting of the Vision Sciences Society (VSS 2013), Naples, FL, USA.
Bonev B , Chuang LL Person and Escolano F (May-2013) How do image complexity, task demands and looking biases influence human gaze behavior? Pattern Recognition Letters 34(7) 723–730.
de la Rosa S Person and Bülthoff HH Person (May-2013) Motor-visual neurons and action recognition in social interactions. Commentary on Mirror neurons: From origin to function Behavioral and Brain Sciences . accepted

Export as:
BibTeX, XML, Pubman, Edoc

 

Automatic Non-Rigid Movement Reconstruction and Analysis

Development of non intrusive communication technologies for research and applications

Rich face models already have a large impact on the fields of computer vision, non intrusive behavior monitoring, perception research, as well as computer graphics and animation. Attributes such as descriptiveness, semantics, and intuitive control are desirable properties but are hard to achieve. Towards the goal of building such high-quality face models, we present a 3D model-based analysis-by-synthesis approach that is able to parameterize 3D point clouds, and that can estimate the state of semantically meaningful components, even from noisy depth data such as that produced by Time-of-Flight (ToF) cameras or devices such as Microsoft Kinect.

Project results and external fundings

 
Perceptual Graphics (Deutsche Forschungsgemeinschaft): The Fusion of Perception Research, Computer Vision and Computer Graphics
Opens external link in new windowProject partners - DFG 
Project-Curio/DFG (Learning-based computer vision approach for the analysis and synthesis of photo realistic 3D facial expressions)
Opens external link in new windowSummary report (Teilprojekt Curio)
 
EU FET-Open (Future and Emerging Technologies), Project TANGO (Emotional Interaction grounded in realistic context)
EU-FET-Open TANGO project webpage
 
 
Main DFG project results 4D implicit surface tracking (DAGM Paper Prize, DFG and EU-TANGO project)
Opens external link in new window4D implicit surface tracking project page (including movie)

Walder C Person, Breidt M Person, Bülthoff HH Person, Schölkopf B Person and Curio C Person: Markerless tracking of dynamic 3D scans of faces, 255-276. In:Dynamic Faces: Insights from Experiments and Computation, (Ed) C. Curio, MIT Press, Cambridge, MA, USA, (December-2010). 
 
Main project results for facial expression morphable model fitting (DFG and EU-TANGO project)
Opens external link in new windowAnalysis by synthesis approach to stereo and noisy 3D point cloud fitting (including movie)

Breidt M Person, Bülthoff HH Person and Curio C Person (March-2011) Robust Semantic Analysis by Synthesis of 3D Facial Motion Ninth IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE, Piscataway, NJ, USA, 713-719. 
Breidt M Person, Bülthoff HH Person and Curio C Person (October-2010): Towards Building a 4D Morphable Face Model, ACM/SSPNET 2nd International Symposium on Facial Analysis and Animation (FAA 2010), Edinburgh, UK.
 
See also our Face and Motion Capture facilities as well as the Motion Tracking facilities for full body capture,
Face Video Database, and the movie sample below.

Markerless model-based face reconstruction from industrial 4D scan data

Model-based face reconstruction from Microsoft's Kinect data

Related publications

9. Giese MA Person, Chiovetto E and Curio C Person (September-2012): Perceptual relevance of kinematic components of facial movements extracted by unsupervised learning, 35th European Conference on Visual Perception, Alghero, Italy, Perception, 41(ECVP Abstract Supplement) 150.
 CiteID: GieseCC2012
8. Breidt M Person, Bülthoff HH Person and Curio C Person (March-2011) Robust Semantic Analysis by Synthesis of 3D Facial Motion Ninth IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE, Piscataway, NJ, USA, 713-719.
CiteID: 7016
7. Breidt M Person, Bülthoff HH Person and Curio C Person (December-2010) Face Models from Noisy 3D Cameras 3rd ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2010), ACM Press, New York, NY, USA, 1-2.
CiteID: 6996
6. Walder C Person, Breidt M Person, Bülthoff HH Person, Schölkopf B Person and Curio C Person: Markerless tracking of dynamic 3D scans of faces, 255-276. In: Dynamic Faces: Insights from Experiments and Computation, (Ed) C. Curio, MIT Press, Cambridge, MA, USA, (December-2010).
CiteID: 5961
5. Breidt M Person, Bülthoff HH Person and Curio C Person (October-2010): Towards Building a 4D Morphable Face Model, ACM/SSPNET 2nd International Symposium on Facial Analysis and Animation (FAA 2010), Edinburgh, UK.
 CiteID: 6798
4. Walder C Person, Breidt M Person, Bülthoff HH Person, Schölkopf B Person and Curio C Person (September-2009) Markerless 3D Face Tracking (DAGM 2009) In: Pattern Recognition, 31. Symposium of the German Association for Pattern Recognition (DAGM 2009), Springer, Berlin, Germany, 41-50.
pdfCiteID: 5899
3. Curio C Person, Breidt M Person, Kleiner M Person, Vuong QC Person, Giese MA Person and Bülthoff HH Person (July-2006) Semantic 3D motion retargeting for facial animation 3rd Symposium on Applied Perception in Graphics and Visualization (APGV 2006), ACM Press, New York, NY, USA, 77-84.
pdfCiteID: 3992
2. Curio C Person and Giese M Person (January-2005) Combining View-based and Model-based Tracking of Articulated Human Movements IEEE Computer Society Workshop on Motion and Vision Computing (MOTION 2005), IEEE Computer Society, Los Alamitos, CA, USA, 261-268.
pdfCiteID: 2889
1. Breidt M Person, Wallraven C Person, Cunningham DW Person and Bülthoff HH Person (July-2003) Abstract Talk: Facial Animation Based on 3D Scans and Motion Capture, Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH 2003), San Diego, CA, USA.
 pdfCiteID: 2319

Export as:
BibTeX, XML, Pubman, Edoc
Last updated: Monday, 29.04.2013