Project Leader

Dr.-Ing. Cristobal Curio
Phone: +49 7071 601-605
Fax: +49 7071 601-616
cristobal.curio[at]tuebingen.mpg.de
 

People

Group members
 

CE Overview Poster


News

04/11/2013 New HMI detectability concept supporting situational awareness featured in IEEE Opens external link in new windowIntelligent Transportation Systems Magazine.
27/09/2013 Computational perception article on view-dependencies of social interaction understanding Opens external link in new windowFrontiers Perception.
26/08/2013 Congratulations to Christian Herdtweck on his successful PhD defense!
29/06/2013 Our approach on Opens external link in new window3D driver head pose monitoring will be presented at Opens external link in new windowTP.CG.2013 conference at Eurographics UK.
24/06/2013 Our cognitive vision architecture on efficient monocular car viewpoint estimation [Opens external link in new windowpdf] has been presented at the Opens external link in new windowIntelligent Vehicles conference.
10/06/2013 We participated in Opens external link in new windowEU-FET-Open (Future and Emerging Technologies) project TANGO. The project has been evaluated as excellent.
20/01/2013  Visual cues determining emotional dynamic facial expression recognition (Opens external link in new windowJournal of Vision)
13/09/2012 Opens external link in new windowBest Conference Paper Award at Opens external link in new windowIEEE conference on Multisensor Fusion and Information Integration (MFI) 2012.
06/03/2012  Enhancing drivers' environment perception presented as Opens external link in new windowtalk (best paper finalist) and novel monocular visual odometry approach at Intelligent Vehicles conference.
05/10/2011 Public release of medial feature grouping and superpixel segmentation Opens external link in new windowcode.
09/ 2011 HMI system for image retrieval presented at INTERACT 2011 conference.
03/2011 Paper presentation at IEEE Automatic Face & Gesture Conference, Santa Barbara. Watch our latest facial analysis video with the Microsoft Kinect sensor on youtube.
10/2010 Our book on Dynamic Faces: Insights from Experiments and Computation has appeared at MIT press.
10/2010 Two SIGGRAPH Asia 2010 Technical Sketches accepted for presentation.
05/2010 Paper at CVPR Conference Workshop on Feature Grouping.
09/2009 We won a DAGM paper prize for work on automatic 3D surface tracking for the generation of a 4D morphable face model. Conference of the German Association for Pattern Recognition (DAGM).

Teaching

WS 2012/13 Opens external link in new windowMedizinische Bildverarbeitung at the Computer Science Department, Tübingen.
SS 2012 Opens external link in new windowMachine Learning II at the Graduate School of Neural Information Processing, Tübingen.
WS 2010/11 Statistical Methods in Artificial Intelligence at the Computer Science Department, Tübingen.
WS 2009/10 Advanced Topics in Machine Learning at the Computer Science Department, Tübingen.

External activities

Opens external link in new windowKI-2013 From Research to Innovation and Practical Applications (Program Committee)
Opens external link in new windowIntelligent Vehicles 2013 PC Associate Editor
WIAF-2012 Workshop Opens external link in new windowWhat's in a face? at ECCV, technical PC.
KI-2012
Associate Editor
06/2011 Organization of workshop on interactive pedestrian behavior analysis and synthesis at IEEE sponsored Intelligent Vehicles, Baden-Baden, June 5, Final program.
11/2011
 PC at 1st IEEE workshop on Information Theory in Computer Vision and Pattern Recognition at ICCV 2011
KI-2011
Program Committee
KI-2010
Area Chair
03/2008
COSYNE conference workshop

Collaborators

Opens external link in new windowCenter for Integrated Neuroscience, Section Computational Motorics (Prof. Dr. M.A. Giese)
Opens external link in new windowAutonomous Systems Lab ETHZ (Prof. Dr. R. Siegwart)
Opens external link in new windowZentrum für Neurowissenschaften Zürich (Prof. Dr. med. A. Luft)
Opens external link in new windowMPI for Intelligent Systems (Prof. M. Black)

Five most recent Publications

Herdtweck C Person and Wallraven C Person (December-2013) Estimation of the Horizon in Photographed Outdoor Scenes by Human and Machine PLoS ONE 8(12) 1-14.
Dobricki M Person and de la Rosa S Person (December-2013) The structure of conscious bodily self-perception during full-body illusions PLoS ONE 8(12) 1-9.
Dobs K Person, Schultz J Person, Bülthoff I Person and Gardner JL (November-10-2013): Attending to expression or identity of dynamic faces engages different cortical areas, 43rd Annual Meeting of the Society for Neuroscience (Neuroscience 2013), San Diego, CA, USA.
Nieuwenhuizen FM Person, Chuang LL Person and Bülthoff HH Person (November-2013) myCopter: Enabling Technologies for Personal Aerial Transportation Systems: Project status after 2.5 years 5. Internationale HELI World Konferenz "HELICOPTER Technologies", "HELICOPTER Operations" at the International Aerospace Supply Fair AIRTEC 2013, Airtec GmbH, Frankfurt a. Main, Germany, 1-3.
pdf
Redcay E , Dodell-Feder D , Mavros PL , Kleiner M Person, Pearrow MJ , Triantafyllou C , Gabrieli JD and Saxe R (October-2013) Atypical brain activation patterns during a face-to-face joint attention game in adults with autism spectrum disorder Human Brain Mapping 34(10) 2511–2523.

Export as:
BibTeX, XML, Pubman, Edoc, RTF

 

Automatic Non-Rigid Movement Reconstruction and Analysis

Development of non intrusive communication technologies for research and applications

Rich face models already have a large impact on the fields of computer vision, non intrusive behavior monitoring, perception research, as well as computer graphics and animation. Attributes such as descriptiveness, semantics, and intuitive control are desirable properties but are hard to achieve. Towards the goal of building such high-quality face models, we present a 3D model-based analysis-by-synthesis approach that is able to parameterize 3D point clouds, and that can estimate the state of semantically meaningful components, even from noisy depth data such as that produced by Time-of-Flight (ToF) cameras or devices such as Microsoft Kinect.

Project results and external fundings

 
Perceptual Graphics (Deutsche Forschungsgemeinschaft): The Fusion of Perception Research, Computer Vision and Computer Graphics
Opens external link in new windowProject partners - DFG 
Project-Curio/DFG (Learning-based computer vision approach for the analysis and synthesis of photo realistic 3D facial expressions)
Opens external link in new windowSummary report (Teilprojekt Curio)
 
EU FET-Open (Future and Emerging Technologies), Project TANGO (Emotional Interaction grounded in realistic context)
EU-FET-Open TANGO project webpage
 
 
Main DFG project results 4D implicit surface tracking (DAGM Paper Prize, DFG and EU-TANGO project)
Opens external link in new window4D implicit surface tracking project page (including movie)

Walder C PersonBreidt M PersonBülthoff HH PersonSchölkopf B Person and Curio C PersonMarkerless tracking of dynamic 3D scans of faces, 255-276. In:Dynamic Faces: Insights from Experiments and Computation, (Ed) C. Curio, MIT Press, Cambridge, MA, USA, (December-2010). 
 
Main project results for facial expression morphable model fitting (DFG and EU-TANGO project)
Opens external link in new windowAnalysis by synthesis approach to stereo and noisy 3D point cloud fitting (including movie)

Breidt M PersonBülthoff HH Person and Curio C Person (March-2011) Robust Semantic Analysis by Synthesis of 3D Facial Motion Ninth IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE, Piscataway, NJ, USA, 713-719. 
Breidt M PersonBülthoff HH Person and Curio C Person (October-2010): Towards Building a 4D Morphable Face Model, ACM/SSPNET 2nd International Symposium on Facial Analysis and Animation (FAA 2010), Edinburgh, UK.
 
See also our Face and Motion Capture facilities as well as the Motion Tracking facilities for full body capture,
Face Video Databaseand the movie sample below.

Markerless model-based face reconstruction from industrial 4D scan data

Model-based face reconstruction from Microsoft's Kinect data

Related publications

9. Giese MA Person, Chiovetto E and Curio C Person (September-2012): Perceptual relevance of kinematic components of facial movements extracted by unsupervised learning, 35th European Conference on Visual Perception, Alghero, Italy, Perception, 41(ECVP Abstract Supplement) 150.
CiteID: GieseCC2012
8. Breidt M Person, Bülthoff HH Person and Curio C Person (March-2011) Robust Semantic Analysis by Synthesis of 3D Facial Motion Ninth IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE, Piscataway, NJ, USA, 713-719.
CiteID: 7016
7. Breidt M Person, Bülthoff HH Person and Curio C Person (December-2010) Face Models from Noisy 3D Cameras 3rd ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2010), ACM Press, New York, NY, USA, 1-2.
CiteID: 6996
6. Walder C Person, Breidt M Person, Bülthoff HH Person, Schölkopf B Person and Curio C Person: Markerless tracking of dynamic 3D scans of faces, 255-276. In: Dynamic Faces: Insights from Experiments and Computation, (Ed) C. Curio, MIT Press, Cambridge, MA, USA, (December-2010).
CiteID: 5961
5. Breidt M Person, Bülthoff HH Person and Curio C Person (October-2010): Towards Building a 4D Morphable Face Model, ACM/SSPNET 2nd International Symposium on Facial Analysis and Animation (FAA 2010), Edinburgh, UK.
CiteID: 6798
4. Walder C Person, Breidt M Person, Bülthoff HH Person, Schölkopf B Person and Curio C Person (September-2009) Markerless 3D Face Tracking (DAGM 2009) In: Pattern Recognition, 31. Symposium of the German Association for Pattern Recognition (DAGM 2009), Springer, Berlin, Germany, 41-50.
pdfCiteID: 5899
3. Curio C Person, Breidt M Person, Kleiner M Person, Vuong QC Person, Giese MA Person and Bülthoff HH Person (July-2006) Semantic 3D motion retargeting for facial animation 3rd Symposium on Applied Perception in Graphics and Visualization (APGV 2006), ACM Press, New York, NY, USA, 77-84.
pdfCiteID: 3992
2. Curio C Person and Giese M Person (January-2005) Combining View-based and Model-based Tracking of Articulated Human Movements IEEE Computer Society Workshop on Motion and Vision Computing (MOTION 2005), IEEE Computer Society, Los Alamitos, CA, USA, 261-268.
pdfCiteID: 2889
1. Breidt M Person, Wallraven C Person, Cunningham DW Person and Bülthoff HH Person (July-2003) Abstract Talk: Facial Animation Based on 3D Scans and Motion Capture, Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH 2003), San Diego, CA, USA.
pdfCiteID: 2319

Export as:
BibTeX, XML, Pubman, Edoc, RTF
Last updated: Wednesday, 06.11.2013