Evidence-Based Management
eBook - ePub

Evidence-Based Management

How to Use Evidence to Make Better Organizational Decisions

Eric Barends, Denise M. Rousseau

Share book
ePUB (mobile friendly)
Available on iOS & Android
eBook - ePub

Evidence-Based Management

How to Use Evidence to Make Better Organizational Decisions

Eric Barends, Denise M. Rousseau

Book details
Book preview
Table of contents

About This Book

Decisions in businesses and organizations are too often based on fads, fashions and the success stories of famous CEOs. At the same time, traditional models and new cutting-edge solutions often fail to deliver on what they promise. This situation leaves managers, business leaders, consultants and policymakers with a profound challenge: how can we stay away from trends and quick fixes, and instead use valid and reliable evidence to support the organization?In response to this problem, evidence-based management has evolved with the goal of improving the quality of decision-making by using critically evaluated evidence from multiple sources - organizational data, professional expertise, stakeholder values and scientific literature. This book sets out and explains the specific skills needed to gather, understand and use evidence to make better-informed organizational decisions. Evidence-Based Management is a comprehensive guide that provides current and future managers, consultants and organizational leaders with the knowledge and practical skills to improve the quality and outcome of their decision-making. Online resources include case studies, exercises, lecture slides and further reading.

Frequently asked questions
How do I cancel my subscription?
Simply head over to the account section in settings and click on “Cancel Subscription” - it’s as simple as that. After you cancel, your membership will stay active for the remainder of the time you’ve paid for. Learn more here.
Can/how do I download books?
At the moment all of our mobile-responsive ePub books are available to download via the app. Most of our PDFs are also available to download and we're working on making the final remaining ones downloadable now. Learn more here.
What is the difference between the pricing plans?
Both plans give you full access to the library and all of Perlego’s features. The only differences are the price and subscription period: With the annual plan you’ll save around 30% compared to 12 months on the monthly plan.
What is Perlego?
We are an online textbook subscription service, where you can get access to an entire online library for less than the price of a single book per month. With over 1 million books across 1000+ topics, we’ve got you covered! Learn more here.
Do you support text-to-speech?
Look out for the read-aloud symbol on your next book to see if you can listen to it. The read-aloud tool reads text aloud for you, highlighting the text as it is being read. You can pause it, speed it up and slow it down. Learn more here.
Is Evidence-Based Management an online PDF/ePUB?
Yes, you can access Evidence-Based Management by Eric Barends, Denise M. Rousseau in PDF and/or ePUB format, as well as other popular books in Business & Management. We have over one million books available in our catalogue for you to explore.


Kogan Page


Evidence from practitioners


ACQUIRE: Evidence from practitioners

What can be asserted without evidence, can be dismissed without evidence
In organizations, evidence from practitioners is an important source of information. In fact, it may well be the most-used source of information in decision-making processes. In many organizations leadership teams ask employees for their input, managers for their opinion, consultants for their experience, and managers often base their decision on this type of evidence. The quality of decisions will significantly improve when you consider all sources of evidence, including professional expertise, as it can connect external evidence such as scientific research findings to the specific organizational context.
There are many ways in which you can acquire evidence from practitioners. Numerous books and websites are available that can inform you about how to gather evidence in a valid and reliable way, covering important aspects such as sampling procedures, research designs and questionnaire development. This chapter therefore does not aim to give a comprehensive and detailed overview of all methods in which you can acquire evidence from practitioners, but rather a quick summary of key aspects that you should take into account.

3.1 What to ask?

Acquiring evidence from practitioners is not a fishing expedition – it starts with an assumed problem, a preferred solution or a deemed opportunity. Before reaching out to practitioners to ask about their take on the matter it is therefore important that you first clearly describe the (assumed) problem that needs to be solved or the opportunity that needs to be addressed. As discussed in Chapter 2, a good definition of the problem entails at least four elements:
  1. The problem itself, stated clearly and concisely (What? Who? Where? When?).
  2. Its (potential) organizational consequences.
  3. Its assumed major cause(s).
  4. The PICOC (Population, Intervention, Comparison, Outcome, Context).
The professional judgement of experienced practitioners inside and outside the organization is an essential component in determining whether the assumed problem is indeed a serious problem and in identifying possible causes. Thus, important questions to ask are:
  1. Do you agree with the description of the problem?
  2. Do you see plausible alternative causes of the problem?
  3. Do you agree that the problem is serious and urgent?
In addition, when you need to make a decision that involves whether to implement a proposed solution, having a clear description of that solution is a prerequisite before you consult practitioners. Again, a good description entails at least four elements:
  1. The solution itself, stated clearly and concisely (What? Who? Where? When?).
  2. Its (potential) effect on the problem and underlying cause/s.
  3. Its costs and benefits.
  4. The PICOC.
As explained, evidence from practitioners is also an essential component in determining how likely a proposed solution is to work in a particular organizational context. In addition, experienced professionals are often in a good position to rate the preferred solution in terms of implementation costs and other feasibility/risk issues. Finally, experienced professionals may think of alternative solutions that you haven’t considered. Thus, important questions to ask are:
  1. Do you agree on which solution is the ‘best’ and/or ‘most feasible’?
  2. Do you see downsides to or unintended negative consequences of the preferred solution?
  3. Do you see alternative solutions to the problem that may work better?

3.2 Whom to ask?

The first step in gathering evidence from practitioners is determining the target audience. Which practitioners in the organization are, given the question or issue at hand, most likely to provide a valid and reliable judgement? Obviously, we want practitioners whose professional judgement is based on a high level of expertise. Expertise refers to skill and knowledge acquired through training and education coupled with prolonged practice in a specific domain, combined with frequent and direct feedback. So, for example, if the question concerns a proposed solution for high levels of staff absenteeism among lawyers in an international accounting firm, then a practitioner who has only a one-time experience with migrant workers picking fruit should obviously not be the first one to invite to give his/her professional judgement. The quality or trustworthiness of practitioner expertise and judgement depends on the relevance of the practitioner’s training, education and experience, which we discuss in Chapter 4.

3.3 How many practitioners should I ask?

Sample size

In most cases, it is impossible to ask all practitioners in the organization to give their judgement, so we need a sample – a selection of practitioners chosen in such a way that they represent the total population. But, how many practitioners should your sample consist of? Should you ask 1 per cent, 5 per cent, 10 per cent or even 50 per cent of the practitioners in the organization? This depends largely on how accurate you want your evidence to be. Most researchers use a sample size calculator to decide on the sample size.1 The required sample size, however, also depends on practical factors such as time, budget and availability. In addition, qualitative methods (for example, focus groups) involve a substantial smaller sample size than quantitative methods (for example, surveys) because for these methods representativeness is often more important than accuracy.

Selection bias

Another major concern is selection bias. Selection bias, also referred to as sampling bias, occurs when your selection of practitioners leads to an outcome that is different from what you would have obtained if you had enrolled the entire target audience.
Figure 3.1
The magazine used a biased sampling plan. They selected the sample using magazine subscriptions, lists of registered car owners and telephone directories. But that sample was not representative of the US public. In the 1930s, Democrats were much less likely to own a car or have a telephone. The sample therefore systematically underrepresented Democrats, and the result was a whopping error of 19 per cent, the largest ever in a major public opinion poll.2
You can prevent selection bias by taking a random sample of the population. However, to get a truly random sample you should not only consider who to ask, but also when to ask. For example, administering a survey on a Monday morning at 9 am to the first 200 employees to start their working day is not random, certainly not when the survey aims to understand the employees’ satisfaction with the company’s flexible working hours. Employees who start their working day on Monday at 9 am may differ from employees who start their working day at 10 am or even later. In addition, some employees with a part-time contract may have a regular day off on Monday. The survey will therefore most likely yield a sample that is not representative for all employees.

3.4 How to ask?

Walking around and asking

The quickest and easiest way to gather evidence from practitioners is by walking around and asking. Of course, thi...

Table of contents

Citation styles for Evidence-Based Management
APA 6 Citation
Barends, E., & Rousseau, D. (2018). Evidence-Based Management (1st ed.). Kogan Page. Retrieved from https://www.perlego.com/book/1589395/evidencebased-management-how-to-use-evidence-to-make-better-organizational-decisions-pdf (Original work published 2018)
Chicago Citation
Barends, Eric, and Denise Rousseau. (2018) 2018. Evidence-Based Management. 1st ed. Kogan Page. https://www.perlego.com/book/1589395/evidencebased-management-how-to-use-evidence-to-make-better-organizational-decisions-pdf.
Harvard Citation
Barends, E. and Rousseau, D. (2018) Evidence-Based Management. 1st edn. Kogan Page. Available at: https://www.perlego.com/book/1589395/evidencebased-management-how-to-use-evidence-to-make-better-organizational-decisions-pdf (Accessed: 14 October 2022).
MLA 7 Citation
Barends, Eric, and Denise Rousseau. Evidence-Based Management. 1st ed. Kogan Page, 2018. Web. 14 Oct. 2022.