Contact

Dr. Isabelle Bülthoff

Address: Spemannstr. 38
72076 Tübingen
Room number: 001.1
Phone: +49 7071 601 611
Fax: +49 7071 601 616
E-Mail: isabelle.buelthoff

 

Picture of Bülthoff, Isabelle, Dr.

Isabelle Bülthoff

Position: Project Leader  Unit: Bülthoff

Faces are the most fascinating objects for human beings. We are never tired of looking at faces, a fact used heavily by advertising companies. In the course of our childhood, we develop a remarkable expertise at deciphering the most subtle aspects of a face, such as recognizing identity and sex, but also noticing, for example, signs of tiredness, sadness or age. I am currently investigating what kind of information we extract from faces either for recognizing them ("this is a picture of Marc") or categorizing them ("these are all Asian faces"). Furthermore, I am testing the importance of body size for face recognition (embodied cognition). In my research I use primarily face images derived from our face database, psychophysical methods, eye- tracking and immersive virtual environments (in collaboration with the PAVE group).

 

Together with Johannes Schultz, I lead the group Recognition and Categorization of the department Human Perception, Cognition and Action.

 

Projects in collaboration with PhD students of the Recognition and Categorisation group include:

 

Teaching: 

What gives a face its ethnicity?    We can quickly and easily judge faces in terms of their ethnicity.  In a series of studies, we investigate various aspects pertaining to ethnicity and the "other race effect". This work is done in part in collaboration with Korea University (BioCyb Lab in the Department of Brain and Cognitive Engineering) and involves participants of different cultural background and expertise in terms of face ethnicities. Furthermore, we used face stimuli derived from our database of Asian and Caucasian faces.  

 

Interplay between sex and identity recognition in familiar faces.   We are very good at recognizing familiar faces. In this project, I test the accuracy of our memory of familiar faces. Futhermore,  I am investigating the impact of idiosyncratic facial features on sex classification.

 

     

Face recognition: Size does not matter.   The concept of “Embodied Cognition” implies that our own bodies, the way we act with our bodies, and the way our bodies “fit” into the environment, should all have important implications for our mental representation of the world. Thus the question arises whether we represent and/or process faces in a different way depending on our body size. This work is done in collaboration with Ian Thornton (University of Swansea, UK) and Betty Tesch (Mohler). For more details on one aspect of this project, see the report below.

 

 

 

   **************************************************************** 

   ****************************************************************

 

Investigating face recognition of active observers using full-bodied avatars in a virtual environment

I. Bülthoff      

 

Introduction

Persons who are much taller or smaller than most others might develop different representations of the world around them and acquire expertise at processing other specific views of their environment. We had looked at the specific case of face recognition in a previous series of desktop experiments and there was no evidence of individuals’ height influencing their representation of others' faces or their ability to process specific views of faces [1]. However, in those experiments as in many others on face recognition [2], face orientation and body height were ambiguous as isolated faces were shown on a computer screen to a passive observer sitting on a chair.

Goals

We designed an experiment that (1) allowed to disambiguate height and orientation of the face stimuli used for face recognition and (2) presented 3D faces on a full body instead of isolated face images and (3) specifically examined the influence of learned viewpoints for face recognition when observers actively viewed 3D-faces.

Methods

A virtual museum was created that contains 20 full-bodied avatars (statues). Half of them were sitting; the others were standing (Figure 1a). Using a head-mounted display, observers walked through the museum three times, approached each statue and viewed them from any horizontal (yaw) angle without time restrictions. We equated eye-level – and thus simulated height -- for all participants and restricted their vertical movement to ensure that the faces of sitting avatars were always viewed from above and standing avatars from below with the same pitch (vertical angle). After familiarization, recognition was tested using a standard old-new paradigm in which 2D images of the learnt faces were shown from various viewpoints (Figure 1b).

Initial results

Figure 2 shows the average performance during the test phase for correctly classifying never seen faces as new and faces that had been viewed in the museum as old. The answers to old faces are separated in two groups. The groups old-congruent and old-incongruent correspond to faces viewed in the test phase either under the same orientation as during learning or under a different orientation, respectively. Participants were significantly better and faster at recognizing faces in the congruent than in the incongruent group (t(23)= 17.16, p< 0.001 and t(23)=-4.13, p = < 0.001 respectively).

 

Initial conclusion

We found a clear influence of learned viewpoint during familiarization. Faces of sitting avatars were recognized more quickly and accurately when viewed from above than from another orientation. Thus, recognition of newly learned faces appears to be view-dependent in terms of pitch angle. Our failure to find a height effect in our previous study suggests that the variety of views of human faces experienced during a lifetime and possibly the preponderance of conversational situations between humans at close range typically counteracts any influence that body size might have on a person’s viewing experience of others’ faces [3].

 

 

 

  

 Museum room with avatars for face recognition exps in virtual reality

Figure 1

Left: partial view of the virtual museum. Right: Incongruent (top) and congruent (bottom) test views of the face of a sitting avatar in the partial view.

 

 ACC and RT recognition performance for Sarah's exp with conguent and inconguent views

 

Figure 2

Left: Accuracy results in percent correct (ordinate) for the new (New) and old faces show in a congruent (Old-c) or incongruent (Old-ic) orientation. Right: Reaction times in ms (ordinate) for the same groups of faces. Error bars represent SEM.

 

 

References             

1. Bülthoff, I, Wolf ,W & Ian M. Thornton, I. M.  (2009). Does your height affect the way you represent faces? Journal of Vision 9  503.

2. Wallraven, C., Schwaninger, A., Schuhmacher, S., & Bülthoff, H.H. (2002). View-Based Recognition of Faces in Man and Machine: Re-visiting Inter-Extra-Ortho 2nd international Workshop on Biologically Motivated Computer Vision, Tübingen, Germany. Lectures Notes in Computer Science, 2525, 651-660.

3. Bülthoff, I, Shrimpton, S & Ian M. Thornton, I. M.  (2011). Using avatars to explore height/pitch effects when learning new faces.  11th Annual Meeting of the Vision Sciences Society (VSS 2011) 11 136.

 

 Education

 

1979 Licence ès Sciences naturelles (equivalent to MA in natural Sciences in the US), University of Lausanne, Switzerland.

 

1983 Ph.D in Zoology, University of Lausanne, Switzerland. Doctoral Dissertation accomplished at the Max-Planck institute for Biological Cybernetics, Tübingen, Germany.

 

 

Academic and Research Experience

 

1977-1978            Teaching assistant in Zoology, University of Lausanne, Switzerland

 

1979-1983            Doctoral work. Doctoral Dissertation: “Visual mutants  of Drosophila melanogaster, functional neuroanatomical mapping of nervous activity by 3H-Deoxyglucose method”. Max-Planck institute for Biological Cybernetics, Tübingen, Germany

 

1983-1885            Postdoctoral fellow, Max-Planck-Institut für biologische Kybernetik, Tübingen, Germany, funded by the Swiss Research Foundation

 

1986-1991            Child rearing period (2 children)

 

1991-1993            Research assistant, Neuroscience Department, (Prof. Barry Connors), Brown University, RI, USA       

 

Since 09/1993       Researcher at the Max-Planck-Institut für biologische Kybernetik, Tübingen, Germany

 

Since 01/2009       Project leader at the Max-Planck-Institut für biologische Kybernetik, Tübingen, Germany

 

 

Major Research Interests

 

Investigating the mechanisms underlying face recognition.  At present my focus is on the following themes:

  • The interplay between gender and identity information in face recognition
  • The impact of voice distinctiveness on face recognition
  • The influence of context and task on face recognition
  • Crosscultural differences in face and object recognition
  • The role of idiosyncratic viewing history in face recognition

Preferences: 
References per page: Year: Medium:

  
Show abstracts

Posters (78):

Fademrecht L, Bülthoff I and de la Rosa S (September-2015): Recognition of static and dynamic social actions in the visual periphery, 15th Annual Meeting of the Vision Sciences Society (VSS 2015), St. Pete Beach, FL, USA, Journal of Vision, 15(12) 494.
Bülthoff I and Zhao M (September-2015): What Type of Facial Information Underlies Holistic Face Processing?, 15th Annual Meeting of the Vision Sciences Society (VSS 2015), St. Pete Beach, FL, USA, Journal of Vision, 15(12) 145.
Bülthoff I, Mohler B and Thornton IM (August-2015): Active and passive exploration of faces, 38th European Conference on Visual Perception (ECVP 2015), Liverpool, UK, Perception, 44(ECVP Abstract Supplement) 51.
Fademrecht L, Barraclough NE, Bülthoff I and de la Rosa S (August-2015): Seeing actions in the fovea influences subsequent action recognition in the periphery, 38th European Conference on Visual Perception (ECVP 2015), Liverpool, UK, Perception, 44(ECVP Abstract Supplement) 214.
Zhao M and Bülthoff I (March-12-2015): Memory of Own- and Other-Race Faces: Influences of Encoding and Retention Processes, International Convention of Psychological Science (ICPS 2015), Amsterdam, The Netherlands.
Fademrecht L, Bülthoff I and de la Rosa S (August-2014): A matter of perspective: action recognition depends on stimulus orientation in the periphery, 37th European Conference on Visual Perception (ECVP 2014), Beograd, Serbia, Perception, 43(ECVP Abstract Supplement) 103.
Zhao M and Bülthoff I (August-2014): Long-term memory for own- and other-race faces, 37th European Conference on Visual Perception (ECVP 2014), Beograd, Serbia, Perception, 43(ECVP Abstract Supplement) 76.
Fademrecht L, Bülthoff I and de la Rosa S (June-2014): Peripheral Vision and Action Recognition, 6th International Conference on Brain and Cognitive Engineering (BCE 2014), Tübingen, Germany.
Zhao M, Hayward WG and Bülthoff I (June-2014): Race of Face Affects Various Face Processing Tasks Differently, 6th International Conference on Brain and Cognitive Engineering (BCE 2014), Tübingen, Germany.
Esins J, Bülthoff I and Schultz J (May-21-2014): Facial motion does not help face recognition in congenital prosopagnosics, 14th Annual Meeting of the Vision Sciences Society (VSS 2014), St. Pete Beach, FL, USA, Journal of Vision, 14(10) 1436.
Zhao M and Bülthoff I (May-20-2014): Face Race Affects Various Types of Face Processing, but Affects Them Differently, 14th Annual Meeting of the Vision Sciences Society (VSS 2014), St. Pete Beach, FL, USA, Journal of Vision, 14(10) 1262.
Fademrecht L, Bülthoff I and de la Rosa S (May-20-2014): Influence of eccentricity on action recognition, 14th Annual Meeting of the Vision Sciences Society (VSS 2014), St. Pete Beach, FL, USA, Journal of Vision, 14(10) 1006.
Dobs K, Schultz J, Bülthoff I and Gardner JL (November-10-2013): Attending to expression or identity of dynamic faces engages different cortical areas, 43rd Annual Meeting of the Society for Neuroscience (Neuroscience 2013), San Diego, CA, USA.
Zhao M and Bülthoff I (August-2013): Learning Faces from Multiple Viewpoints Eliminates the Other-Race Effect, 36th European Conference on Visual Perception (ECVP 2013), Bremen, Germany, Perception, 42(ECVP Abstract Supplement) 204.
Brielmann A, Bülthoff I and Armann R (August-2013): Looking at faces from different angles: Europeans fixate different features in Asian and Caucasian faces, 36th European Conference on Visual Perception (ECVP 2013), Bremen, Germany, Perception, 42(ECVP Abstract Supplement) 204.
Dobs K, Bülthoff I, Breidt M, Vuong QC, Curio C and Schultz JW (August-2013): Quantifying Human Sensitivity to Spatio-Temporal Information in Dynamic Faces, 36th European Conference on Visual Perception (ECVP 2013), Bremen. Germany, Perception, 42(ECVP Abstract Supplement) 197.
Jung W-M, Bülthoff I, Thornton I, Lee S-W and Armann R (May-13-2013): The Role of Race in Summary Representations of Faces, 13th Annual Meeting of the Vision Sciences Society (VSS 2013), Naples, FL, USA, Journal of Vision, 13(9) 861.
Esins J, Schultz J, Kim BR, Wallraven C and Bülthoff I (November-2012): Comparing the other race effect and congenital prosopagnosia using a three-experiment test battery, 13th Conference of the Junior Neuroscientists of Tübingen (NeNA 2012), Schramberg, Germany.
Esins J, Bülthoff I, Kennerknecht I and Schultz J (September-2012): Can a test battery reveal subgroups in congenital prosopagnosia?, 35th European Conference on Visual Perception, Alghero, Italy, Perception, 41(ECVP Abstract Supplement) 113.
Dobs K, Bülthoff I, Curio C and Schultz J (August-2012): Investigating factors influencing the perception of identity from facial motion, 12th Annual Meeting of the Vision Sciences Society (VSS 2012), Naples, FL, USA, Journal of Vision, 12(9) 35.
Bülthoff I (August-2012): What gives a face its ethnicity?, 12th Annual Meeting of the Vision Sciences Society (VSS 2012), Naples, FL, USA, Journal of Vision, 12(9) 1282.
Esins J, Schultz J, Kim BR, Wallraven C and Bülthoff I (July-2012): Comparing the other-race-effect and congenital Prosopagnosia using a three-experiment test battery, 8th Asia-Pacific Conference on Vision (APCV 2012), Incheon, South Korea, i-Perception, 3(9) 688.
pdf
Jung W, Armann R and Bülthoff I (July-2012): What gives a face its race?, 8th Asia-Pacific Conference on Vision (APCV 2012), Incheon, South Korea, i-Perception, 3(9) 697.
pdf
Gaissert N, Waterkamp S, van Dam L and Bülthoff I (September-2011): Cross-modal transfer in visual and haptic object categorization, 34th European Conference on Visual Perception, Toulouse, France, Perception, 40(ECVP Abstract Supplement) 134.
Dobs K, Kleiner M, Bülthoff I, Schultz J and Curio C (September-2011): Investigating idiosyncratic facial dynamics with motion retargeting, 34th European Conference on Visual Perception, Toulouse, France, Perception, 40(ECVP Abstract Supplement) 115.
Lee RK, Bülthoff I, Ammann R, Wallraven C and Bülthoff HH (September-2011): The other-race effect is not ubiquitous, 11th Annual Meeting of the Vision Sciences Society (VSS 2011), Naples, FL, USA, Journal of Vision, 11(11) 626.
Esins J, Bülthoff I and Schultz J (September-2011): The role of featural and configural information for perceived similarity between faces, 11th Annual Meeting of the Vision Sciences Society (VSS 2011), Naples, FL, USA, Journal of Vision, 11(11) 673.
pdf
Bülthoff I, Shrimpton S, Mohler BJ and Thornton IM (September-2011): Using avatars to explore height/pitch effects when learning new faces, 11th Annual Meeting of the Vision Sciences Society (VSS 2011), Naples, FL, USA, Journal of Vision, 11(11) 596.
Bülthoff I, Lee RK, Wallraven C and Bülthoff HH (August-2010): No other-race effect found in a task using faces differering only in race-specifying information, 33rd European Conference on Visual Perception, Lausanne, Switzerland, Perception, 39(ECVP Abstract Supplement) 90.
Armann RGM, Jeffery L, Calder A, Bülthoff I and Rhodes G (May-2010): Race-specific norms for coding face identity and a functional role for norms, 10th Annual Meeting of the Vision Sciences Society (VSS 2010), Naples, FL, USA, Journal of Vision, 10(7) 706.
Bülthoff I (August-2009): Sex categorization is influenced by facial information about identity, 32nd European Conference on Visual Perception, Regensburg, Germany, Perception, 38(ECVP Abstract Supplement) 78.
Gaissert N, Wallraven C and Bülthoff I (July-2009): From unsupervised to supervised categorization in vision and haptics, 10th International Multisensory Research Forum (IMRF 2009), New York, NY, USA.
Armann R and Bülthoff I (August-2008): Categorical perception of male and female faces and the single-route hypothesis, 31st European Conference on Visual Perception, Utrecht, Netherlands, Perception, 37(ECVP Abstract Supplement) 117.
Bülthoff I and Vuong QC (August-2007): The effect of context in face and object recognition, 30th European Conference on Visual Perception, Arezzo, Italy, Perception, 36(ECVP Abstract Supplement) 146.
Bülthoff I, Wolf T and Thornton IM (July-2007): Looking Down, Looking Up: Does Stature Influence Face Recognition?, 10th Tübinger Wahrnehmungskonferenz (TWK 2007), Tübingen, Germany.
Armann R and Bülthoff I (July-2007): Sex Matters When You Ask the Right Question: What Affects Eye Movements in Face Comparison Tasks?, 10th Tübinger Wahrnehmungskonferenz (TWK 2007), Tübingen, Germany.
Armann R and Bülthoff I (June-2007): Sex matters when you ask the right question: What affects eye movements in face comparison tasks?, 7th Annual Meeting of the Vision Sciences Society (VSS 2007), Sarasota, FL, USA, Journal of Vision, 7(9) 5.
pdf
Michel C, Rossion B, Hayward W, Bülthoff I and Vuong Q (June-2007): The role of surface and shape information in the other-race face effect, 7th Annual Meeting of the Vision Sciences Society (VSS 2007), Sarasota, FL, USA, Journal of Vision, 7(9) 7.
Bülthoff I and Newell FN (August-2006): Cross-modal interaction can modulate face distinctiveness, 29th European Conference on Visual Perception, St. Petersburg, Perception, 35(ECVP Abstract Supplement) 204.
Bülthoff I and Newell FN (June-2006): Voices, not arbitrary sounds, prime the recognition of familiar faces, 6th Annual Meeting of the Vision Sciences Society (VSS 2006), Sarasota, FL, USA, Journal of Vision, 6(6) 10.
Bülthoff I and Newell FN (March-2006): Face Distinctiveness can be Modulated by Cross-Modal Interaction with Auditory Stimuli, 9th Tübingen Perception Conference (TWK 2006), Tübingen, Germany.
Bülthoff I (February-2005): Sensitivity to changes in identity, caricature and sex in face recognition, 8th Tübingen Perception Conference (TWK 2005), Tübingen, Germany.
Bülthoff I and Newell FN (September-2004): Interactions between audition and vision for face recognition, 27th European Conference on Visual Perception, Budapest, Hungary, Perception, 33(ECVP 2004 Abstract Supplement) 108.
Bülthoff I, Klatzky RL and Newell FN (February-2004): Haptic Magnitude Estimates of Size for Graspable Shapes, 7th Tübingen Perception Conference (TWK 2004), Tübingen, Germany.
Bülthoff I, Newell FN and Bülthoff HH (November-2003): Interaction between vision and audition in face recognition, 44th Annual Meeting of The Psychonomic Society, Vancouver, Canada, Abstracts of the Psychonomic Society, 8 57.
Bülthoff I and Newell FN (October-2003): Interaction between vision and speech in face recognition, Third Annual Meeting of the Vision Sciences Society (VSS 2003), Sarasota, FL, USA, Journal of Vision, 3(9) 825.
Bülthoff I and Newell FN (February-2003): Cross-modal Aspect of Face Distinctiveness, 6. Tübinger Wahrnehmungskonferenz (TWK 2003), Tübingen, Germany.
Bülthoff I (November-2002): No categorical perception of face gender found with different discrimination tasks, Second Annual Meeting of the Vision Sciences Society (VSS 2002), Sarasota, FL, USA, Journal of Vision, 2(7) 620.
Bülthoff I (February-2002): Face gender is not perceived categorically, 5. Tübinger Wahrnehmungskonferenz (TWK 2002), Tübingen, Germany.
Knappmeyer B, Tappe C and Bülthoff I (February-2002): Recognizing faces across different views: does caricaturing help?, 5. Tübinger Wahrnehmungskonferenz (TWK 2002), Tübingen, Germany.
pdf
Page:  
1, 2, 3

Export as:
BibTeX, XML, Pubman, Edoc, RTF
Last updated: Monday, 22.05.2017