Aviation Social Science: Research Methods in Practice

Mark W. Wiggins, Catherine Stevens

• Publisher: Routledge
• Year: 2016
• Print ISBN:
  9781840149661
• eBook ISBN:
  9781351956208
• Topic: Technology & Engineering
• Subtopic: Industrial Engineering
• Index: Technology & Engineering

This book is a guide that addressees social science research issues within the aviation industry. Studies involving human factors, personality, training systems evaluation, decision-making, crew resource management and situation awareness are used to illustrate not only the process, but also the outcomes that can emerge from social science research. The book describes the principles involved in conceptualising a research problem, obtaining management support, developing an appropriate timeframe, obtaining ethics approval and collecting and managing data. It also provides useful guidelines concerning the publication of research in magazines, academic journals and conference presentations. The topics are illustrated with aviation examples and the principles are deliberately broad. This book will be a useful guide for both novice and experienced researchers, especially pilots, air traffic controllers, maintenance personnel, aviation management, aviation researchers, safety personnel and undergraduate and postgraduate university students.

1 Introduction

Ranging from the interpretation of accident/incident statistics at one extreme through to the evaluation of the outcomes of training initiatives at the other, 'research' offers a framework for effective decision-making and planning within complex industrial environments. Research provides the means for assessing market share, evaluating safety levels, projecting client demands, and/or identifying system failures. Consequently, the principles of research form an integral part of the successful management and maintenance of systems within the operational aviation environment.

Consistent with this perspective, the value of research within the operational environment is often evaluated on the basis of its outcomes, such as improved productivity or performance, and a consequent reduction in expenditure. Furthermore, the payoffs associated with research outcomes are expected to occur within a relatively short time frame, with as little investment as possible.

However, despite the desire for a structured, outcome-driven approach to the research process, the reality is considerably more complex, and it is often difficult to evaluate the product of research in purely economic terms. For example, the observers of the Wright brothers' initial flights found it particularly difficult to imagine the broader application of such an invention (McFarland, 1953), Indeed, as late as 1910, the brothers continued to experience a number of problems convincing the mainstream community of the value of aircraft (McFarland, 1953). This type of response exemplifies the need to consider research as a long-term investment that has the potential to yield significant outcomes, rather than as a 'single shot' attempt to solve complex problems.

Although 'single shot' research is attractive from an economic perspective, it should be noted that by far the greatest advances in modern science have generally occurred through a relatively systematic, cumulative approach to problem-solving. Typically, this involves an element of trial and error or 'educated' guesses such that particular avenues of thought are investigated and either pursued or disregarded depending upon the outcomes. This provides the basis for the development of a body of knowledge that, in turn, enables the development of effective and efficient solutions. Research into the causes of smallpox is an example of this type of research, where a number of approaches were investigated, some of which held promise, while others were disregarded as ineffective. However, the cumulative body of research provided a basis for understanding the nature and spread of smallpox and, therefore, facilitated the development of effective measures of eradication (Rains, 1974).

Aviation research is typical of most domains in which the progression of research outcomes has been characterised by initial, significant breakthroughs, followed by somewhat less significant refinements of existing knowledge. For example, although the Wright Flyer represented a particularly significant advance in the development of fixed-wing aviation, the components that constitute the design of more contemporary aircraft remain relatively consistent with the fundamental components that enabled the Wright Flyer to take to the air. This 'building block' approach to research is consistent with the history of research in other domains including medicine and biology, and is reflected in the saying 'we know more and more about less and less'. As a result, it is important to place the outcome of an individual research project in perspective, and consider it as part of a progression of research outcomes, rather than seek a panacea for all of the ills that confront a complex domain such as aviation.

The development of reasonable expectations is a significant part of the research process, although it is a lesson that is often learnt through painful experience. New researchers, in particular, tend to approach a project with the expectation that the outcomes will effect substantial changes within an area of study, either in terms of the acquisition of knowledge, or through the advancement of systems or technology. Typically, this expectation is directly proportional to the amount of time and energy invested in the project. However, for every scientist who has a place in history, there are many others whose effort and commitment to the research process were no less impressive. The difference lies both in the 'accidents' of history and the ability to capitalise upon those 'accidents' that do occur.

The relative value of a particular research study can be difficult to gauge, particularly during the early stages of the research process. Indeed, there have been dozens of cases throughout history in which researchers have posited theoretical positions that were considered impossible at the time. As early as 1694, Galileo supported the then heretical notion proposed by Copernicus that the earth revolved around the sun (Drake, 1957). Considered ludicrous at the time, Galileo and Copernicus were ultimately proven accurate, and this theoretical perspective altered both the nature of astronomy, and the philosophical perception of the place of humanity within the universe.

One of the most significant features associated with Galileo's research was the extent to which it impacted upon at least two relatively distinct research disciplines: astronomy and philosophy. However, the application of a single research outcome to more than one discipline is not a characteristic that is unique to Galileo. As an example, much of the aviation-related knowledge developed to ensure the destruction of the Axis powers during World War II was used subsequently as the basis for advances within civilian aviation. Similarly, the developments that have occurred within the commercial airline environment have provided the basis for improvements within general aviation.

The transfer of research outcomes between domains has also been evident in the development of training initiatives, particularly those associated with crew resource management. Helmreich and Davies (1997) noted that crew resource management initiatives, originally proposed for the aviation environment, have now been applied within domains as diverse as medicine and mining. Moreover, the principles of CRM are such that they have application to any complex domain where individuals are required to function as a team.

Despite the apparent ease with which research outcomes within one domain appear to be transferable to another, it is a strategy that is dependent upon an understanding of both the nature of the domain and the opportunities and limitations afforded by the research process. This book introduces readers to the process of research as it applies to human performance in the aviation environment. Furthermore, it outlines some of the assumptions associated with the research process in general and, more particularly, explores a number of different types of research paradigms. This aim of the book is to provide a foundation for systematic evaluations of aviation-related human performance, based upon sound methodological principles. To this end, the book provides a combination of both theoretical principles and practical guidelines to assist in the development, conduct and evaluation of research within an aviation context.

The structure of Aviation Social Science: Research Methods in Practice parallels the research process, beginning with the identification of an appropriate research problem. Although it may appear a relatively elementary task, the development of an appropriate research question can be one of the most difficult issues to confront the researcher. Therefore, Chapter 2 includes a list of potential text and web-based sources of information that will assist the development of aviation-related research questions. In addition, Chapter 2 discusses the principles of theory development as they apply to human performance research in aviation. Finally, the chapter includes an introduction to the characteristics and the generation of research questions and hypotheses.

Once an appropriate research question has been identified, the researcher is faced with an important decision concerning the type of investigative strategy that might be employed. In particular, there are a number of different approaches to research within the aviation environment including field observation, critical incident analysis, and task analysis. Each method has advantages and disadvantages, depending upon the particular circumstances within which it is applied. Chapter 3 explores a number of these approaches in some detail, and discusses their merits and pitfalls. In addition, a number of examples are described that illustrate the application of general research principles to particular aspects of the aviation environment.

Ultimately, the selection of a specific research strategy will involve a balance between a number of competing demands, including the requirement to adhere to appropriate ethical principles. An ethical approach to research ensures that potential participants are safeguarded from any harm that may emerge as part of the research process. Chapter 4 considers not only the nature of this relationship as it applies to the aviation environment, but also outlines a number of examples to illustrate the potential ethical dilemmas that can emerge for any researcher. Finally, guidelines are provided to facilitate the development and application of research strategies within an appropriate ethical context. Combined with the information provided in previous chapters, these guidelines establish the basis for the development of a research proposal.

The value in developing a research proposal is often overlooked, despite the fact that it offers an opportunity to consider, at the outset, the multitude of factors that are likely to impact upon the success of a particular research endeavour. These factors may include political issues, costs associated with the research process, the potential for methodological errors, and/or the potential for errors associated with the analysis of data. Chapter 5 examines both the role of the research proposal, and some of the mechanisms whereby these factors may be taken into account. It is designed to provide a practical approach that anticipates the conduct or process of research.

Throughout the book, there is an emphasis on the everyday, applied issues associated with the research process. This involves dealing with the various aspects of the aviation industry that are likely to be critical to the outcomes of the research. Aviation, like many other commercial industries, considers research as it does any other investment. There are costs associated with the acquisition of data, the outcomes of which may not yield sufficient benefits to the organisation. Therefore, an important part of the process of research involves the development of clear and concise arguments associated with the cost-benefits of research within the aviation environment. Chapter 6 considers the practical issues associated with conducting research and provides some guidelines to assist in obtaining a favourable outcome. However, it should be recognised that there are particular idiosyncrasies associated with the aviation system that may impact upon the quality of the research outcome, irrespective of the time and the investment made during the research planning phase. Ultimately, this is both the attraction and the risk associated with research in any applied environment.

Another part of research planning involves a consideration of the type of information or data that might be acquired, together with the techniques of data acquisition. A significant issue to face the researcher is whether the data will be quantitative, such as test scores, or qualitative, such as open-ended responses, or a combination of both. This will determine the types of data analytic procedures that may be applied. Chapter 7 is designed to introduce some of the issues involved in the analysis of research data. In particular, the notions of validity and reliability are examined, and a number of principles of data analysis are considered. This chapter provides a foundation for Chapters 8 and 9 that discuss inferential and qualitative data analytic techniques. These latter chapters have been designed to provide an introduction to the principles of data analysis, rather than a definitive account of the various procedures that might be applied. As there are comprehensive textbooks available regarding these techniques, readers are referred to useful resources in the area.

The penultimate chapter is designed to consider the publication of research outcomes. It is motivated by the view that researchers have a responsibility to publish the outcomes of research and contribute to the knowledge base within a particular area. In some cases, the publication of the outcomes of research will be more or less applicable to particular audiences. Therefore, the chapter considers the process of publishing in academic journals and in industry-based publications. Clearly, the audience for the two types of publications will be quite different, and the style of writing may reflect those differences. However, irrespective of the approach, the publication of sound research findings can meet the needs of both researchers and the operational personnel for whom the research may have been undertaken.

Given the expansion of the aviation industry and the demands for productivity and safety improvements, there is a growing need for human performance research within this complex and fascinating environment. Aviation Social Science: Research Methods in Practice is designed to introduce readers to aviation-related research and to stimulate their interest in the research process. To this end, all of the concepts, technical terms and research strategies that are discussed are related to the aviation environment. Furthermore, examples are used throughout the text to provide a concrete basis for the acquisition of knowledge and practical skills in the planning, conduct, and analysis of aviation-related research. One experimental example recurs throughout the text, presented in an information box. Important concepts are illustrated using this ongoing experimental theme.

Aviation Social Science: Research Methods in Practice is structured to mirror the research process. Despite its modular format, an effective method to grasp the concepts and ideas is to read through the material sequentially, as the later chapters tend to build upon concepts discussed earlier. A glossary of terms is provided towards the back of the book.

There is no need to possess an academic background to be effective as a researcher. Rather, research requires an inquiring mind, a passion for knowledge, and an organised and pragmatic approach to getting things done. These are elements that have characterised some of the most famous researchers throughout history, from Plato to Copernicus to Edison. Aviation Social Science: Research Methods in Practice is designed to develop fundamental research skills. Moreover, it provides a sound foundation for new researchers to investigate various aspects of the aviation environment with the confidence that they are using appropriate methods and techniques.

2 Identifying a Research Problem in Aviation

2.1 Introduction

Isolating a research problem within the aviation environment is not an easy task. First, novice researchers often find it difficult to know where to start isolating or defining a problem. Second, the success or otherwise of a research project is typically dependent upon the cooperation of an organisation that may or may not be comfortable with the research process. Finally, while it may be possible to solicit the cooperation of an aviation-based organisation, gaining the cooperation of potential participants is another matter entirely. Each of these factors contributes, at some level, to the difficulties faced by researchers during the process of scientific enquiry.

While acknowledging the difficulties associated with isolating research problems within the aviation environment, it is also important to acknowledge the significance that research plays, both in achieving changes within society, and in facilitating the development of safety-oriented initiatives.

This chapter considers the process of problem identification within the applied aviation environment. It begins with an analysis of the ways in which a problem can be identified and defined. The chapter then considers the nature of the scientific method and the distinction between basic and more applied research. This leads to a consideration of the 'research question' and the various types of questions that are employed within social science. A significant part of the problem-identification process is the review and analysis of relevant literature and the subsequent development of a parti...

Table of contents

• Cover
• Half Title
• Title
• Copyright
• Contents
• List of Tables, Figures and Boxes
• Acknowledgements
• Foreword
• List of Abbreviations
• 1 Introduction
• 2 Identifying a Research Problem in Aviation
• 3 Social Science Research Strategies in Aviation
• 4 Ethics and Research
• 5 Writing a Research Proposal
• 6 Conducting Social Science Research in Aviation
• 7 Introduction to Quantitative Data Analysis
• 8 Inferential Statistics in Aviation Research
• 9 Qualitative Data Analysis
• 10 Publishing Research
• 11 Conclusion
• Glossary of Terms
• References
• Index