It is tempting to jump right in and start talking about evaluation methods and the tingling satisfaction of proving that a public communication campaign or project was effective in achieving its objectives and generating results. This discussion will get into the nitty-gritty very soon – but, first, it is essential to understand and remind ourselves of a few very important things about communication.
Communication is recognized as fundamental to all aspects of human society. John Dewey famously said that ‘society exists . . . in communication’ (1916, p. 5). Raymond Williams echoed Dewey in saying that ‘society is a form of communication’ (1976 [1962], p. 10). However, communication between humans is a far more complex, uncertain and variable process than most of us care to admit. We know that communication is something that all humans do to some extent from soon after birth. But to assume that attempts at communication are always, or even mostly, effective is to ignore the wars, divorces, breakdowns of friendships, family fallings-out, feuds, misunderstandings and other disruptions that occur every day in human society.
In an address to aspiring communication students some years ago, I reminded them that:
Public communication
In contrast with interpersonal communication between two individuals (dyads) and within small groups, public communication refers to communication activities that take place in the public sphere (Habermas, 1989 [1962], 2006) rather than the private sphere (Chartier, 1989; Hansson, 2007) – albeit the separation of private and public is an increasingly blurred boundary in contemporary societies (Baxter, 2011). Also, public communication usually relates to matters of public interest rather than private affairs. Furthermore, those at whom it is aimed are commonly referred to as publics1 (Eliasoph, 2004; Grunig & Hunt, 1984) and sometimes as target publics or target audiences. Individuals and groups with a vested interest in an organization, or which are directly affected by the activities of an organization, such as customers, shareholders, partners and affiliates, employees and sometimes local communities, are also referred to as stakeholders,2 because they have a stake in the organization (Freeman, 1984). Sometimes, there are others who seek to have a stake or say in the activities of an organization and these are referred to in some literature as stakeseekers3 (Heath, 2002; Spicer, 2007). In the interests of simplicity, this text will refer to all such groups as audiences.
Recognizing that communication is meant to be two-way, it should be noted that organizations that seek to engage in communication with various publics and stakeholders are also audiences – or at least they should be, as I argued in Organizational Listening: The Missing Essential in Public Communication (Macnamara, 2016a). Communication requires speakers and listeners – or authors and audiences – to interact reciprocally.
Communication between organizations and individuals, such as letters, emails and complaints processed through customer service call centres, may not always be public in terms of being open for all to hear or see, but they are public in the sense of being part of organization–public relationships, abbreviated in public relations (PR) practice to OPR (Broom, Casey & Ritchey, 1997; Heath, 2013). Similarly, internal communication inside organizations, commonly referred to as organizational communication – although it would be more accurately called ‘intra-organizational communication’ – is also public communication. While management and employees engage in private interpersonal discussions in relation to individuals’ pay and performance, internal organizational communication addresses many or all members of an organization on matters of common concern. Internal organizational communication recognizes employees as key publics or stakeholders, and uses a range of public communication media and methods, such as the Internet, newsletters, videos, presentations, events and so on.
The website of the School of Communication at American University (2016) in Washington DC says of public communication: ‘It’s at the heart of our economy, society, and politics. Studios use it to promote their films. Politicians use it to get elected. Businesses use it to burnish their image. Advocates use it to promote social causes.’
Public communication campaigns are public communication activities that ‘use the media, messaging, and an organized set of communication activities to generate specific outcomes in a large number of individuals and in a specified period of time’ (Coffman, 2002, p. 2; Rogers & Storey, 1987, p. 821). Similarly, Charles Atkin and Ronald Rice say: ‘Public communication campaigns can be defined as purposive attempts to inform or influence behaviours in large audiences within a specific time period using an organized set of communication activities and featuring an array of mediated messages in multiple channels’ (2013, p. 3).
Despite their considerable cost in terms of both time and money, such campaigns are often not rigorously evaluated, partly because of the widespread assumption that communication efforts will have the desired effect This ignores the reality that others might have different views, beliefs, levels of literacy, and social and cultural influences. When hundreds of thousands, or even millions, of dollars, euros, pounds sterling or other currency units are spent on public communication, such as in major advertising, PR or public engagement campaigns, it is important to remember the famous statement by marketing pioneer John Wannamaker:4 ‘Half of my advertising is wasted; the only trouble is I don’t know which half’ (as cited by Albanese, 2007, p. 10, and in Stewart, Pavlou & Ward, 2002, p. 357).
Isabelle Albanese says that acceptance of Wannamaker’s dilemma ‘just doesn’t cut it anymore’ (2007, p. 10). A 50/50 chance of success is not acceptable in today’s age of accountability, tight budgets and performance management. Even if one accepts Wannamaker’s statement as a generalization, there is empirical evidence showing that public communication materials and campaigns, however creative and professionally packaged, regularly do not create the desired effects. A cover story in Advertising Age in 2006 reported market research that found 37.3 per cent of marketers’ advertising budgets to be wasted because they are ineffective (Albanese, 2007, p. 10). The following section will present further evidence that much public communication fails to achieve the intended outcomes. That is not an indictment of the ability or work ethic of the instigators of that communication. Rather, it is a reflection of the complex range of variables that affect public communication, the susceptibility of audiences to other competing and contrary influences and messages, and sometimes the resistance of audiences (Knowles & Linn, 2004) – factors that necessitate evaluation.
Evaluation can apply to specific campaigns, or even to specific activities within campaigns, such as media advertising, publicity, events, websites and publications. However, a single communication initiative such as an event or website, and even a campaign, rarely has significant outcomes and impact. In discussing health communication, D. Lawrence Kincaid and colleagues point out that a single campaign is usually only one phase in a series of campaigns and other types of intervention designed to achieve desired results (Kincaid, Delate, Storey, & Figueroa, 2013, p. 305). Learning from evaluation of campaigns should be incorporated into planning of future campaigns to gain incremental improvement. Thus it is productive to think of evaluation beyond the scope and time scale of any one campaign.
Furthermore, the concept of campaigns narrows the focus to planned purposive communication designed to achieve specific results desired by an organization. As Brenda Dervin and Lois Foreman-Wernet say, ‘no matter how carefully cloaked as attempts to “understand” and benevolently reach audiences, the intent of the campaign remains top-down social control – to entice audiences to comply with what experts deem appropriate’ (2013, p. 148). Public communication needs to be understood and considered more broadly as the ongoing communicative interaction between organizations and their various audiences – and vice versa. Today, public communication occurs 24/7, not only within the semi-controlled confines of campaigns. Public communication occurs every time an official gives a speech, every time someone posts a tweet on Twitter and every time a photo is posted on Facebook, Instagram or Pinterest. Public communication other than that planned by a particular organization occurs regularly, such as independent media reporting, public complaints, protests, petitions, social media comments and various other day-to-day expressions of the ‘will of the people’. Organizations need to monitor and evaluate what others say. Also, they often need to respond to communication initiated by others, such as letters, emails, website inquiries and social media discussion. Therefore, while this analysis of evaluation can be applied to campaigns, it discusses evaluation of public communication, not only of campaigns, recognizing that public communication is an ongoing, two-way process involving a range of channels and activities.
Throughout the twentieth century, it was common to refer to mass communication in discussing public communication with large groups of people. However, this understanding of communication is mostly associated with mass media, such as newspapers, radio and television, which dominated the mediascape during the twentieth century, as well as the questionable concept of mass society (Hoggart, 2004; Williams, 1976 [1962]). Public communication is a more inclusive term than mass communication because it applies to all channels used for direct and mediated communication, and it recognizes a range of audiences with differing interests and views rather than one ‘imagined’ mass audience (Anderson, 1991 [1983]).