Research Group: Cognition and Control in Man-Machine Systems
Supervisor: Lewis Chuang, PhD
My research seeks to identify the real-time physiological measurements that correspond to a user's psychological states during closed-loop control tasks. This is primarily studied both in basic experiments as well as in the context of a high-fidelity flight simulator. In the course of my PhD, I intend to derive a robust online metric for measuring mental workload. The availability of reliable measurements for the actual level of mental workload will allow control machine systems to adapt to the real-time abilities and limitations of the user.
The human operator can perform at acceptable levels even if he is experiencing high levels of workload. Nonetheless, sustained periods of high workload can cause fatigue and sudden drops in performance. Being able to assess the level of workload during an ongoing task might provide a method to predict this drops in performance.
In a closed-loop control task, such as driving, various factors can affect operational workload. These factors include the visualization of the information, external disturbances and the complexity of the controller dynamics.
The traditional way to measure workload is by assessing the subjectively perceived workload with questionnaires, like the NASA-TLX.
To measure operator workload continuous and unobtrusive, event-related potentials, derived from the EEG, can be used instead. It has been shown that the P3, a component of the event-related potential, elicited by events in a secondary task, are sensitive to changes in primary task difficulty.
The disadvantage of this method is that a secondary task might interfere with the primary steering task. To avoid that, ignored events should be used instead, to elicit the P3. The amplitude of the P3 response to task-irrelevant stimuli is claimed to reflect the availability of general attentional resources. Thus, high workload conditions are expected to reduce its amplitude.
In the first part of this project, I investigated the feasibility of estimating operator workload for different influencing variables, with the P3, elicited by ignored sounds. Following this, I will employ online methods to classify different levels of workload during real-time closed-loop control task across different implementation scenarios in the field of aviation.
Participants are typically required to perform a basic compensatory control task in a fixed-base flight simulator, wherein they have to counteract unpredictable movements in the roll axis. Task difficulty is influenced by either modulating the bandwidth of the forcing function or by changing the order of the controller dynamics of the system. This is expected to increase operator workload. In addition, the visualization complexity of the flight task is also manipulated. As a baseline measure, workload is estimated from self-reported questionnaires (i.e., NASA-TLX).
In addition, task-irrelevant auditory stimuli are occasionally presented and their elicited P3 potentials are evaluated according to my manipulations in the control task.
1) Increasing the disturbance that the participants need to counteract for as well as increasing the complexity of the controller dynamics result in decreases in control performance and subjectively perceived workload. P3 amplitudes are shown to be sensitive to large changes in workload.
2) Increasing visualization complexity diminishes our ability to accurately perceive control errors. However, it does not influence subjective workload and P3 amplitude.
The P3, elicited by ignored events, allow for different aspects of a closed-loop control task to be evaluated for their impact on the operator's workload, without disrupting the ongoing task. To do so robustly, it is necessary to develop effective measurement paradigms and identify EEG metrics that are sensitive to changes in the operator's workload.
Since 11/12 PhD student at Max Planck Institute for Biological Cybernetics (Dept. Bülthoff)
09/05-09/08 Diploma Elektrotechnik/Nachrichtentechnik at the BA Friedrichshafen
10/10-10/12 Master Biomedizinische Technik at the TU Berlin
09/08-09/10 Engineer at EADS Ulm
08/11-10/12 Science Guide at the Otto Bock science center of medical technology
05/12-10/12 Research in migraine therapy with TMS
, und (März-2016) Steering demands diminish the early-P3, late-P3 and RON components of the event-related potential of task-irrelevant environmental sounds
Frontiers in Human Neuroscience 10(73) 1-15.
Beiträge zu Tagungsbänden (4):
, und (Oktober-2015) On the influence of steering on the orienting response In: Trends in Neuroergonomics, , 11. Berliner Werkstatt Mensch-Maschine-Systeme, Universitätsverlag der TU Berlin, Berlin, Germany, 24.
, und (September-2015) On the Cognitive Demands of Different Controller Dynamics: A within-subject P300 Analysis, Human Factors and Ergonomics Society Annual Meeting (HFES 2015), Sage, London, UK, 1042-1046.
, und (September-2014) Is the novelty-P3 suitable for indexing mental workload in steering tasks?, 12th Biannual Conference of the German Cognitive Science Society (KogWis 2014), Springer, Berlin, Germany, Cognitive Processing, 15(Supplement 1), S135-S137.
, , und (Juni-2014) The Influence of Visualization on Control Performance in a Flight Simulator In: Engineering Psychology and Cognitive Ergonomics, , 11th International Conference on Engineering Psychology and Cognitive Ergonomics (EPCE 2014), held as Part of HCI International 2014, Springer, Berlin, Germany, 202-211, Series: Lecture Notes in Artificial Intelligence ; 8532.
, und (März-9-2015): Measuring workload during steering: A novelty-P3 study, 57th Conference of Experimental Psychologists (TeaP 2015), Hildesheim, Germany.
(Oktober-6-2016) Abstract Talk: Attending to the Auditory Scene Improves Situational Awareness, 1st Neuroergonomics Conference: The Brain at Work and in Everyday Life, Paris, France.
und (September-19-2016) Abstract Talk: Evaluating steering demands from EEG/ERP responses
to task-irrelevant distraction, 50. Kongress der Deutschen Gesellschaft für Psychologie (DGPs 2016), Leipzig, Germany 49.
, , , und (April-1-2014) Abstract Talk: Closed-loop control performance and workload in a flight simulator, 56th Conference of Experimental Psychologists (TeaP 2014), Giessen, Germany 45.