Neuroergonomics
eBook - ePub

Neuroergonomics

A Cognitive Neuroscience Approach to Human Factors and Ergonomics

A. Johnson, R. Proctor, A. Johnson, R. Proctor

Share book
  1. English
  2. ePUB (mobile friendly)
  3. Available on iOS & Android
eBook - ePub

Neuroergonomics

A Cognitive Neuroscience Approach to Human Factors and Ergonomics

A. Johnson, R. Proctor, A. Johnson, R. Proctor

Book details
Book preview
Table of contents
Citations

About This Book

This book covers the foundations and successes of Neuroergonomics, combining neuroscience and ergonomics to enhance efficiency and safety. An overview of the essential areas within the field is given including chapters on brain networks, perception, attention, and performance.

Frequently asked questions

How do I cancel my subscription?
Simply head over to the account section in settings and click on “Cancel Subscription” - it’s as simple as that. After you cancel, your membership will stay active for the remainder of the time you’ve paid for. Learn more here.
Can/how do I download books?
At the moment all of our mobile-responsive ePub books are available to download via the app. Most of our PDFs are also available to download and we're working on making the final remaining ones downloadable now. Learn more here.
What is the difference between the pricing plans?
Both plans give you full access to the library and all of Perlego’s features. The only differences are the price and subscription period: With the annual plan you’ll save around 30% compared to 12 months on the monthly plan.
What is Perlego?
We are an online textbook subscription service, where you can get access to an entire online library for less than the price of a single book per month. With over 1 million books across 1000+ topics, we’ve got you covered! Learn more here.
Do you support text-to-speech?
Look out for the read-aloud symbol on your next book to see if you can listen to it. The read-aloud tool reads text aloud for you, highlighting the text as it is being read. You can pause it, speed it up and slow it down. Learn more here.
Is Neuroergonomics an online PDF/ePUB?
Yes, you can access Neuroergonomics by A. Johnson, R. Proctor, A. Johnson, R. Proctor in PDF and/or ePUB format, as well as other popular books in Psychology & Neuropsychology. We have over one million books available in our catalogue for you to explore.

Information

Year
2013
ISBN
9781137316523

1

The Working Brain

Addie Johnson, Jacob Jolij, Raja Parasuraman and Paolo Toffanin
Neuroergonomics has been defined as the study of the brain and behaviour at work (Parasuraman & Rizzo, 2007). The major goal of this new field is to use existing and emerging knowledge from the neurosciences to inform understanding of human behaviour and performance in work-relevant tasks. As such knowledge is gained, the hope is that we can design systems and work environments that are safe, efficient and enjoyable for their users. Reaching such a goal is made even more important by the relentless march of new, small information technologies in the marketplace—iPhones, global positioning systems (GPS), voice-operated devices and so forth impose new information-processing demands on their users. These devices can impair safety if they are used by people while they are simultaneously engaged in other activities, such as driving or walking across a busy intersection (e.g. Strayer & Drews, 2004).
Such technological advances are affecting not only civilian life, but the military as well. For example, the United States Air Force Chief Scientist recently released a report that details the expanding mismatch between human ‘warfighters’ and the technology available to them (Chief Scientist Air Force, 2010). The report attempts to make the case that as technological capacity continues to increase it will become increasingly important to examine the role of the human as a link in security and other systems. It is evident that now, more than ever, the military needs ergonomics research to enhance human–machine systems. The Air Force Chief Scientist report goes on to identify ‘augmentation of human performance’ as one of two key areas where substantial growth is possible in the coming decade (p. vii) and calls specifically for ‘direct augmentation of humans via drugs or implants to improve memory, alertness, cognition, or visual/aural acuity’ (p. viii), as well as ‘direct brainwave coupling between humans and machines, and screening of individual capacities for key specialty codes via brainwave patterns and genetic correlators’ (p. 58). In other words, cognitive science and cognitive neuroscience must be combined with traditional ergonomics to create new neuroergonomic applications.
Although much of the interest in, and funding for, neuroergonomic research has come from the military, key areas of neuroergonomics, such as operator– state-based adaptive automation and brain–computer interfaces, have applications in a range of work, transportation and leisure environments. The development of neuroergonomic applications requires an understanding of the tasks to be performed, the cognitive processing involved in their performance, and the existence of a set of techniques to measure or influence cognitive processing. Many books and articles have been devoted to task analysis and cognitive work analysis (e.g. Diaper & Stanton, 2004; Vicente, 1999). It can be argued that neuroergonomics, in seeking to apply neuroscience to system design, starts where cognitive task analysis leaves off. Instead of describing cognitive processing activities as, for example, ‘memory’ or ‘decision making’, an understanding of functional neuronal networks underlying those activities is applied to assess the quality of information processing and to intervene to improve system performance.
Much of what we know or hypothesize about neuronal networks comes from single-cell studies with animal subjects (e.g. BuzsĂĄki, 2006; Kandel et al., 2013). Developments in neuroimaging are, however, making it increasingly possible to test hypotheses about how information is processed in the brain in healthy humans. Neuroimaging methods allow us to infer neuronal activity in terms of localized changes in blood flow or metabolism [positron emission tomography (PET)] or in terms of changes in blood oxygenation level dependent (BOLD) responses [functional magnetic resonance imaging (fMRI)]. Tracers that bind to different receptors have been used in combination with PET to examine transmitter density; pathways of activation can now be imaged using diffusion tensor imaging (DTI), in which MRI is used to trace white matter tracts. Lesion studies have played an important role in mapping brain regions to function and, in addition to the study of naturally-occurring lesions, transcranial magnetic stimulation (TMS) is being used to induce, on a short timescale, disruptions in normal brain processing to test conclusions about causal relations between brain activity and behaviour. Finally, measurement of electric [electroencephalogram (EEG)] or magnetic [magnetoencephalogram (MEG)] signals at the scalp can be used to provide detailed information about the time-course of information processing and, increasingly, its locus. Used separately or together, these methods and others (e.g. transcranial Doppler sonography, near-infrared spectroscopy, deep brain stimulation) form the toolkit of the neuroscientist studying the physiology of human brain networks.
These various neuroimaging techniques have been used extensively in cognitive neuroscience studies in which naïve participants, typically college undergraduates, are tested while performing simple laboratory tasks of perception and cognition (Gazzaniga, 2009). In contrast to cognitive neuroscience, one of the goals of neuroergonomics is to examine brain function in the more complex and dynamic tasks representative of everyday, naturalistic environments at work, in the home or in transportation, and—where possible—in expert populations, such as pilots, physicians or military personnel. From small beginnings, following the initial call for such research (Parasuraman, 2003), a growing number of studies have examined human brain function in work-relevant tasks. Examples include fMRI studies of frontal and parietal cortical networks involved in simulated driving (Just et al., 2008) and how they are altered in intoxicated drivers (Calhoun & Pearlson, 2012); EEG investigations of pilot mental workload during actual and simulated flight (Wilson, 2001) and the usability of hypermedia systems (Schultheis & Jameson, 2004); and functional near infrared spectroscopy (fNIRS) studies of frontal lobe activation in experts performing simulated minimally-invasive surgery (James et al., 2011).
Brain stimulation techniques, such as TMS and transcranial direct current stimulation (tDCS), can supplement the use of neuroimaging techniques in neuroergonomics. Such techniques are of interest because of their potential for showing that brain networks that have been identified in neuroimaging studies are not only active, but are necessary for performance of a given task. This is typically achieved by showing that task performance is impaired when the associated brain region is momentarily inhibited using TMS (Walsh & Pascual-Leone, 2005) or tDCS (Jacobson et al., 2012). Of the two techniques, tDCS has some advantages over TMS for neuroergonomic studies because of its relative non-invasiveness, greater portability and lower cost. These methods also allow for the possibility of enhancement of human performance through electrical or magnetic stimulation of the brain. Again, whereas these techniques have been used primarily in studies of basic perception and cognition, they are making their way into neuroergonomic research. Examples include TMS investigations of reasoning and complex decision-making, (McKinley et al., 2012) and tDCS studies of detection of military threats in naturalistic scenes (Clark et al., 2012).
Imaging tells us much more about the brain than simply ‘where things are happening’ (but see, e.g., Uttal, 2011, for a dissenting view). For example, measurements of brain activity before a stimulus is presented can tell us how well subjects will remember a stimulus (Otten et al., 2002; Turk-Browne et al., 2006) or are prepared for a task (Leber et al., 2008; Toffanin et al., 2009). Posner and Rothbart (2007) argue that imaging is just beginning to realize its potential in elucidating (a) different brain networks, (b) neural computation in real time, (c) how assemblies develop over the lifespan and (d) neural plasticity following brain insult or training. As discussed in Chapter 8, a new development, the mapping of the human genome (Venter et al., 2001), offers great potential for understanding the physical basis for individual differences. Molecular genetics provides a set of methodological tools that can inform many issues concerning human brain function. Methods such as candidate-gene analysis and genome-wide association (GWAS) are being used to relate genetic differences to individual performance in tasks involving the network influenced by particular types of genes.

Brain structures and networks

The starting point for neuroergonomics is the brain. A comprehensive introduction to the structure and workings of the brain is beyond the scope of this book, but it is helpful to sketch the major structures and processing networks involved in perceptual, cognitive, motor and emotional processing (see Figure 1.1). A rough guide to the brain ascribes executive function to the frontal lobe; motor planning and execution to primary motor cortex (somatomotor cortex) and pre-motor areas of the frontal lobe; the integration of sensory information from different modalities, particularly when the spatial location of objects must be determined, to the parietal lobe—and to the temporal lobe when objects must be identified; visual processing to the occipital lobe; and auditory processing to the temporal lobes. The temporal lobes are also involved in semantic processing of both speech and vision, and the hippocampus, located in the medial portion of the temporal lobes, is involved in memory formation. The cerebellum plays an important role in the integration of sensory perception and motor output. The cerebellum interacts with the motor cortex and spinocerebellar tract (which provides proprioception) to fine-tune equilibrium, posture and motor learning. The brain stem (pons, medulla oblongata and midbrain) is a small structure involved in sensation, vision, arousal, consciousness, motor function, emotion, alertness and autonomic reflexes.
Assigning cognitive functions to brain areas has heuristic value, but most information processing involves multiple areas of the brain and depends on dynamic changes in the brain. Perhaps the most important dynamic process in the brain (other than neural transmission itself) is long-term potentiation, a long-lasting enhancement in signal transmission between two neurons that results from synchronous firing of the neurons. Long-term potentiation enhances synaptic transmission, improving the ability of pre- and postsynaptic neurons to communicate with one another across a synapse, and thus contributes to synaptic plasticity, such as that underlying learning and memory. Another aspect of brain dynamics is synchronization of brain areas. Many recent hypotheses of how information is transmitted between brain areas (e.g. Donner & Siegel, 2011) suggest that it occurs via synchronization of oscillations in different frequency bands.

A default mode of brain function

A relatively recent discovery (Raichle & Snyder, 2007; Raichle et al., 2001) is that the brain not only increases in activity during information processing, but also that there is a ‘default mode’ of brain function supported by a processing system which includes the posterior cingulate cortex and adjacent precuneus. Evidence for a default mode of brain function comes from neuroimaging studies that show task-specific deactivation. Many neuroimaging techniques rely on the comparison of task and control conditions, and almost always report an increase in activity in the task compared with the control condition. However, subtracting task-state data from control-state data in some cases reveals negative activity or task-specific deactivation (e.g. Petersen et al., 1998; Raichle et al., 1994). Surprisingly, these decreases in activity have been found even when the control condition is resting with the eyes closed or simply keeping the eyes at fixation. In other words, even when people are assumed to be refraining from information processing activity, engaging in some other activity results in a reduction of brain activity. This reduction relative to baseline is the key piece of evidence pointing to a default mode of brain function.
How does one characterize activity in a passive or resting condition? Raichle et al. (2001) answer this question with regard to activity observed during task processing. They argue that the regional decreases seen during the performance of a task represent the presence of functionality that is ongoing in the resting state and attenuated only when resources are temporarily reallocated during goal-directed behaviour. Default activity can thus be defined only in reference to task activity. The fact that the spatially coherent, spontaneous BOLD activity that is the hallmark of intrinsic activity is also present under anaesthesia (Vincent et al., 2007) suggests that the activity is not associated with conscious mental activity, but rather may reflect a fundamental property of the functional organization of the brain. An intriguing idea is that the default network reveals the maintenance of information for interpreting, responding to or even predicting environmental changes. In this sense, understanding the default network may help us to understand much more about how we adapt to, and learn from, the environment.

Assessing and influencing brain function

Of the techniques available for neuroimaging and mapping brain function, the ones with the most direct application in neuroergonomics are TMS, tDCS, fNIRS and EEG. However, even though techniques such as MRI and DTI are relatively expensive to use, the development of magnet-compatible virtual reality systems has led to fMRI studies of complex cognition, including simulated driving (Calhoun & Pearlson, 2012) and complex spatial navigation (Maguire, 2007). Moreover, structural MRI and DTI have been used to quantify the effects of training methods, such as emphasis change (Boot et al., 2010), video game training (Voss et al., 2012) or working memory training (Takeuchi et al., 2010a).

TMS and tDCS

TMS has been used since 1985 to manipulate brain function in a non-invasive, focal manner (Barker et al., 1985). Designed on the principle of electromagnetic induction, TMS involves passing an electrical current through a magnetic coil placed close to the head of the subject. The magnetic field penetrates through the skull and into the outer layers of cortical tissue where it induces electrical activity in neurons in the targeted area. Although the technique has been used primarily to explore the function of various brain regions, an important observation is that exposure to TMS sometimes leads to enhancement in perceptual or cognitive abilities. Exactly how TMS influences brain function is not completely clear, but it is thought to work by changing the membrane potential in neurons. When cognitive abilities are enhanced, this may be through neuronal pre-activation or priming. According to this view, stimulating a region of the brain pre-activates the neurons in that region, increasing their propensity to fire. Support for this view comes from the finding that TMS applied to an area leads to an increase in regional blood flow (as measured by fMRI) and metabolism (George & Belmaker, 2007).
Most cognitive research has used single-pulse TMS, in which only one magnetic pulse is delivered. Clinical work, however, has focused on the possibility of using repetitive-pulse TMS (rTMS). Just a single pulse of TMS can interfere momentarily with the functioning of a region or enhance excitability in a region for a short amount of time [less than 500 ms—although these stimulations may have longer-lasting effects on more distant cortical regions (Pascual-Leone et al., 2000)]. rTMS often has longer-lasting effects (Walsh & Cowey, 2000). Unfortunately, the possibilities of rTMS with respect to enhancing cognitive function (or ameliorating the effects of a disorder) are offset by questions about the safety of the technique and the risk of unpleasant side-effects. A related technique, tDCS, involves passing a mild direct electrical current between electrodes on the scalp to modify neuronal membrane resting potential. This is done in a polarity-dependent manner, such that neuron excitability in a given region is either elevated or lowered (Wagner et al., 2007). Both TMS and tDCS might be used to enhance perceptual and cognitive performance (see Chapter 3 and, for a review, Thut et al., 2011).

fNIRS

fNIRS is a relatively new technique that shows promise as a field-deployable, non-invasive monitor of prefrontal cortex (PFC) activity. This technology uses light to measure changes in blood oxygenation as oxy-haemoglobin (HbO2) converts to deoxy-haemoglobin (HbR) during neural activity (i.e. the haemodynamic response). Because the light can be introduced at the scalp via a sort of headband containing light emitting diodes (LEDs), the technology is portable and relatively non-intrusive. The spatial resolution of fNIRS is about 1 cm2, making it possible to test hypotheses about changes in the use of brain regions as a function of learning, in addition to testing general mental activity (Ayaz et al., 2012). Moreover, fNIRS can be combined with EEG to achieve better temporal resolution (Gratton & Fabiani, 2007). In one implementation of fNIRS (Ayaz et al., 2012), light sources and detectors for 16 optodes are placed in a flexible sensor pad which is worn over the forehead. Source detectors are separated by 2.5 cm, allowing for approximately 1.25 cm penetration depth. The LEDs are activated one at a time, with a temporal resolution of 500 ms per scan. The placement of the detectors allows the monitoring of dorsal and inferior frontal cortical areas. Changes in light absorption are analysed using spectroscopy for the detection of the chromophores of HbO2 and HbR. As discussed in Chapter 4, fNIRS shows promise as a means to measure mental workload and changes in level of expertise.

EEG

EEG is a graph of electrical brain activity in which the vertical axis represents the difference in voltage between two different scalp locations (as measured by electrodes attached to the scalp) and the horizontal axis time (Fisch, 1999). The EEG is composed of three types of neural activity (Hermann et al., 2004): (1) spontaneous activity uncorrelated with any particular task; (2) induced activity related to the task, but unrelated to particular events (not phase-locked); and (3) evoked activity related to particular events (phase-locked).
A Event-related potentials
Much EEG research relies on the event-related potential (ERP; see Luck, 2005). To compute the ERP, a sample of the EEG activity is recorded just prior to and after a discrete stimulus event. Many (usually at least 100) such samples are taken and are averaged offline, thus ‘averaging out’ spontaneous EEG activity and resulting in an ERP waveform containing activity that is phase-locked to the stimulus onset. Changes in the amplitude and latency of the different positive and negative peaks in the ERP are used to draw conclusions about the mental operations associated with the task.
A number of components of the ERP have been identified and linked to information processing (Handy, 2004; Luck, 2005; Regan, 1989; see Table 1.1). ERP components can be divided roughly into early, exogenous components, which reflect the processing of stimuli, and late-onset, endogenous components related to cognitive processing. For e...

Table of contents