Post-Project Reviews to Gain Effective Lessons Learned

Terry Williams

• Publisher: Project Management Institute
• Year: 2007
• Print ISBN: 9781933890241
• eBook ISBN: 9781628251258
• Topic: Business
• Subtopic: Organisational Development
• Index: Business

A key component of successful project management is the ability to glean key learnings from the experience throughout the lifecycle of the project, as well as at its conclusion. However, in practice, the lessons learned from a specific project are rarely incorporated into an organization's overall policies and procedures. Without a concerted effort to reflect on specific project learning's and a designated process to implement them across the organization, lessons are lost, mistakes are repeated and opportunities for operational efficiency are missed.

1

INTRODUCTION

1.1 Introduction

The need to manage projects well, and to learn from one project to the next, is of vital importance as our world becomes more and more project-based. Our management of complex projects is often seen as less effective than it might be, and consequently, we do need to learn from one project to the next. This is a well-known theory (Collison and Parcell 2001; Kerzner 2000)—but in practice, projects are often not reviewed at all for various reasons (Williams et al. 2001) If they are reviewed, the methods don’t account for the complexity or try to explain causality, so there is no understanding about what went wrong (or right) and why (MacMaster 2000). So with a few exceptions, it appears that project reviews are infrequently performed and useful lessons are not captured. If we did gain lessons, these need to be incorporated into the processes and policies of our organizations; a “lessons learned” process needs to be implemented and then reflected upon to produce double-loop learning. The need to consider what is best practice in reviewing projects is evident.

At the end of 2004, while working at Strathclyde University, Glasgow, Scotland, UK, I responded to a request for research proposals from the Project Management Institute (PMI^®), Newtown Square, PA, USA, with a proposal to look into post-project reviews, and PMI awarded me a research grant. In the middle of the contract, I moved to Southampton University, UK (also Concertante Consulting, London, UK) and the work was completed there.

The objectives of the research include identifying current practice as well as practice currently considered best practice for lessons learned in the project management field, and comparing current practices with advances in understanding and modeling of project behavior to identify project lessons not being learned. This work sought to answer the following research questions which are of different types; therefore, different methodological approaches were required as is often the case with good management research (Easterby-Smith, Thorpe, and Lowe 1991).

1. Research Question 1 (RQ1) comprised two questions: “What is current practice?” and “What is currently considered best practice?” These are factual questions that are best explored using positivist techniques. A literature survey (Activity 1) and questionnaire (Activity 2) were used to investigate this.
2. Research Question 2 (RQ2) asked “Do these techniques actually achieve their purpose?” and is harder to answer with an unambiguous positivist answer. A literature survey (Activity 1) and questionnaire (Activity 2) along with interviews to gain subjective opinions (Activity 3), and some phenomenological analyses of an actual case study (Activity 4) were used to investigate whether these cases are indeed establishing the difficult-to-identify lessons.
3. Research Question 3 (RQ3) asked “Can we identify practical techniques to help draw out the difficult lessons from the projects?” is a practical question, and was approached by using the knowledge from Activities 1 through 3 and drawing out the experience of Activity 4, along the lines of Mode II research common in top-quality UK management research (Starkey and Madan 2001).
4. Research Question 4 (RQ4) asked “How can such lessons be incorporated into organizational practice?” Although a short research project, this is again a practical question, which will be approached by considering the literature (Activity 1), looking at actual practices (Activity 2), and considering both by interviews (Activity 3) and observations (Activity 4) as to how and whether lessons are taken into organizational procedures.

The program thus consisted of four main activities. The first pair of activities established the current state of practice:

• 
     Activity 1 carried out a survey of literature relevant to learning lessons in projects.
• 
     Activity 2 surveyed the current practice of establishing and recording “lessons learned” throughout the project management community using an online questionnaire survey.

The second pair of activities, which formed the considerably smaller part of the study, looked at some particular examples:

• 
     Activity 3 looked more in depth into current practice in six organizations, using semi-structured interviews.
• 
     Activity 4 looked at a particular organization, and a particular project within that organization, to see how lessons are learned and how they can be learned.

I led the research work. A significant part of the work for Activities 1 and 2 was carried out by Judith Stark (also of Strathclyde University, Glasgow, Scotland, UK). For Activity 1, there was some additional help with literature.

This research report on the work is divided into six chapters. After this introduction, Chapters 2 through 4 correspond to Activities 1–4; Chapter 2 covers the literature survey; Chapter 3 covers the online survey; Chapter 4 describes the interviews; and Chapter 5 reviews the case study. Chapter 6 provides some brief conclusions. Chapters 2–5 are designed to be self-standing and each can be read on their own.

2

LITERATURE SURVEY

2.1 Introduction

This chapter describes the results of the survey of literature on the use of “lessons learned” from projects. The report was based on a Procite^© database, which included not only references but a categorization by the keywords given in Table 2-1. The database included 280 records, of which 243 documents had been read fully and are discussed in the following paragraphs. For 28 references, only summaries, abstracts, or book reviews were studied or are included because they are referenced by one of the 243 documents; and another 9 appeared relevant but were not found sufficiently appropriate for inclusion when the literature survey was written up and therefore do not appear here. Due to the tremendous number of documents, this survey should be considered as a summary rather than a full exploration of the literature.

The survey was wide-ranging and sought views beyond the project-management literature. Databases (including Google scholar) were used with relevant keywords. Key papers were selected and “forward chaining” was performed (i.e., searching citation indexes for papers that refer to these papers). Some particularly relevant journals were checked in their entirety for the previous 10 years, namely:

• 
  Construction Management and Economics
• 
  IEEE Transactions on Engineering Management
• 
  International Journal of Project Management
• 
  Management Learning (only from Vol 29 [March 1998] to present)
• 
  Organization Science
• 
  Project Management Journal
• 
  The Learning Organization

In addition, some conferences were checked in their entirety, namely:

• 
  PMI full conferences 2001–2003
• 
  PMI Research Conferences 2000–2004
• 
  IPMA conferences 1996–2004
• 
  IRNOP (International Research Network on Organizing by Projects) conferences 2002-2004
• 
  PMI Europe conferences 2000–2001

The Index of PMI Periodical Publications: 1996–2002, supplied by PMI, was also studied.

The topic of lessons learned can be regarded as very narrow or very broad. Clearly, it is important to gain the theoretical underpinnings of the how-to-learn lessons, and this means going beyond reports of implementations of project learning. However, the review of the entire organizational learning and knowledge management literatures was outside of the scope of this study; therefore, this survey contains only articles particularly relevant to project learning or fundamental articles or review articles of state-of-the-art theory. For those who want to read further about the literature on learning, DeFillippi (2001) gives an overview on different perspectives of learning from projects and where to find more about them, covering: (a) action learning (Revans, Smith)—people learn by working on real problems; (b) action science (Argyris and Schon)—project participants reflect on theories in use with the help of a facilitator; (c) action research (Lewin)—combines theory building with research on practical problems; (d) communities of practice (Wenger, Brown, and Duguid)—learning occurs naturally through communities, with the deepest learning occurring when people’s positions move within a community and at the intersections of multiple communities; and (e) reflective practice (Raelin). Much of this will be touched upon as part of this book.

The problem of how to learn from projects has long been an issue with project-based organizations, and this book will discuss some of the reasons why. Almost forty years ago, Middleton (1967) identified this as a problem with project-based organizations as opposed to functional ones: “Lessons learned on one project may not be communicated to other projects. One executive who was transferring from a project being phased out to a new project found the same mistakes being made that he had encountered on his former assignment three years earlier. He felt that the problem resulted from splitting normal functional responsibilities among project organizations and from not having enough qualified, experienced employees to spread among all organizations.” Although our views of projects might be different today, Packendorff (1995), a leader in the Scandinavian school looking at projects as organizations rather than tools and seeking to go beyond normative statements, said “theories on learning in projects…are almost non-existent today.” This is despite a clear recognition, as Sense (2002) points out, that projects offer enormous potential for learning even though this is neglected in traditional project management practice.

Learning clearly always happens to some extent by the nature of undertaking projects. Schofield and Wilson (1995), for example, looked at capital projects within the UK National Health Service and observed that learning did happen (in three ways: termed mechanical, cognitive, and behavioral) but they concluded “none of the team set about achieving organizational learning in a premeditated way.” In this book, we are looking towards the more systematic collection and distribution of lessons from projects. Ayas (1998) said that “learning within a project does not happen naturally; it is a complex process that needs to be managed. It requires deliberate attention, commitment, and continuous investment of resources” (cited in Sense 2003a).

This document is restricted to learning about project processes or how to manage and execute projects. It is not aimed towards learning technical knowledge from projects (such as in work along the lines of Nobeoka 1995)—it is about the project-management process rather than the content of projects.

Case studies	Case studies of companies that use lessons learned
Communities of practice (general)	General papers about communities of practice or similar networks
Communities of practice (projects)	Papers about communities of practice or similar networks where the issues are specific to projects and related to process rather than content
Facilitating factors and hindrances	Factors which facilitate or hinder collecting lessons or distributing lessons
General personal learning	Gene...

Table of contents

• Cover Page
• Title Page
• Copyright Page
• Contents
• 1 - Introduction
• 2 - Literature Survey
• 3 - Survey of Practice: Do Organizations Learn from Projects?
• 4 - Interviews: Do Organizations Learn from Projects?
• 5 - Case Study in Practice
• 6 - Conclusions
• Appendix 1: The Zoomerang Survey
• Appendix 2: The Zoomerang Results
• Appendix 3
• References