Practical Web Analytics for User Experience

How Analytics Can Help You Understand Your Users

Michael Beasley

• Publisher: Morgan Kaufmann
• Year: 2013
• ISBN:
  9780124046948
• Topic: Diseño
• Subtopic: Diseño UI/UX

Practical Web Analytics for User Experience teaches you how to use web analytics to help answer the complicated questions facing UX professionals. Within this book, you'll find a quantitative approach for measuring a website's effectiveness and the methods for posing and answering specific questions about how users navigate a website. The book is organized according to the concerns UX practitioners face. Chapters are devoted to traffic, clickpath, and content use analysis, measuring the effectiveness of design changes, including A/B testing, building user profiles based on search habits, supporting usability test findings with reporting, and more. This is the must-have resource you need to start capitalizing on web analytics and analyze websites effectively.

• Discover concrete information on how web analytics data support user research and user-centered design
• Learn how to frame questions in a way that lets you navigate through massive amounts of data to get the answer you need
• Learn how to gather information for personas, verify behavior found in usability testing, support heuristic evaluation with data, analyze keyword data, and understand how to communicate these findings with business stakeholders

Chapter 1

Introduction

Contents

What Is Web Analytics?

User Experience and Web Analytics Questions

Web Analytics and User Experience: A Perfect Fit

About This Book

Part 1: Introduction to Web Analytics

Part 2: Learning About Users through Web Analytics

Part 3: Advanced Topics

Google Analytics

Imagine you have just wrapped up a round of usability testing on your organization’s website. Half of your 10 test participants clicked on a misleading link and then immediately clicked the Back button and tried a different link. Clearly, there’s a problem here, but key stakeholders are unconvinced. They tell you that your sample size is too small to produce any statistically significant findings. Luckily, you have web analytics data available to you, and you can show that this is a common path for 63% of the website’s users over the last year. In addition, users spend, on average, among the lowest amount of time on that page that they accidentally go to compared to the rest of the website. Not only do you now have more evidence to show to stakeholders, you also have a better sense of the scale of the problem.

It turns out that your organization’s web analytics expert had often wondered why the average time on that page was so low, yet had so many pageviews. He knew something was wrong with those two pages because of the way users moved back and forth, but it was data from the usability test that showed exactly how the labeling misled some users.

User experience (UX) professionals have a strong track record of building bridges to other fields and finding ways to utilize whatever data they can gather. Web analytics is one such valuable source of data. Web analytics experts can be a great ally, helping UX professionals understand data and find ways to measure aspects of user behavior that they need. In turn, UX professionals provide web analytics experts with a perspective on users that they can’t readily access.

However, UX professionals, like yourself, who work with websites and mobile applications (apps) can get a great deal of value from learning to work directly with web analytics. Using these tools not only allows you more immediate access to data, it also allows for the kind of open exploration and deep, iterative analysis that can be challenging when you work through an intermediary. A major drawback of relying on web analytics experts is that they won’t necessarily focus on the kinds of questions that are important to you—they may focus on measuring the effectiveness of online marketing efforts or simply filling requests for data. Adding web analytics tools as a regular part of your practice lets you build expertise in answering questions about users’ behavior and measuring the effectiveness of design changes. Web analytics can also help you communicate with stakeholders about how usability problems affect users and help you argue for important design and research activities.

This book is geared toward UX practitioners, from those just starting out to management, who want to add another source of data about users to their toolkit. It is for people familiar with or experienced in other user research methods, such as usability testing and contextual inquiry, or engaged in design. Readers do not need to be familiar with web analytics, but this book will be the most valuable for people who enjoy solving puzzles and are excited by the thought of working with numbers.

What is Web Analytics?

Web analytics is a way of learning how users interact with websites and mobile apps by automatically recording aspects of users’ behavior and then combining and transforming the behavior into data that can be analyzed. The scale of the data collection—that is, the large number of visits that can be recorded—and the approaches to analysis described in this book differentiate web analytics from other user research methods.

The most fundamental and useful information web analytics tools record is the pages a user views, when he or she views it, and in what order. From this sliver of insight into user behavior, web analytics tools stitch together the story of how each user moves through a website. They also capture how a user got to a website, such as by doing a search in a search engine or following a link from another website, and technical details like the user’s browser and screen resolution. With the right tool or with the addition of the right code, almost anything a user can do on a website can be recorded, combined with other data, and analyzed.

These tools have matured considerably since the mid-2000s and their use has grown as a result. Much of the use of web analytics tools has been in the realm of online marketing, a field concerned with introducing a company’s brand to people and enticing them to become customers. Web analytics has fueled growth in online marketing because it allows marketers to measure the effectiveness of their work, through such metrics as the number of people who reach their website and go on to buy something—data that can be compared to the amount of money spent to acquire those visitors.

User Experience and Web Analytics Questions

The term user experience has different meanings depending on whom you talk to and is the subject of some disagreement. This book is not intended as an entry into any debate over the term. For the purpose of this book, user experience is meant to describe the practice of utilizing user research and design techniques—including usability testing, user personas, and user-centered design—to make items usable, useful, and delightful.

As UX professionals, we want to understand what users do and why they do it. Our traditional research methods have typically involved observing the behavior of small samples of representative users. The kinds of UX questions one might ask are: “What problems do users encounter when performing this task?” “How do users understand the way information is organized?” “Why do people click on this button rather than that other button on the same page?”

Web analytics data tell you what large numbers of users have done on your website. These tools capture data on nearly every user who comes to your website and allow you to answer “what” questions rather than “why” questions. That is, you can learn what the most and least viewed pages on your website are and what the people who ended up buying something on your website typed in your search box. What web analytics can’t tell you is why users did or didn’t view those pages, and what those users meant when they entered a particular search query.

One may ask “what” questions, such as “How many users visited the website on a mobile device last week?” For some, the answer may be useful by itself, but many people, from various fields, want to know not just this simple fact but also how the behavior of mobile users differ from that of desktop users. UX professionals are uniquely positioned to provide information that can contextualize web analytics data.

Web Analytics and User Experience: A Perfect Fit

Web analytics does not replace any UX methods. It simply adds to and complements them. For the most part, user experience is geared toward providing insight into how users behave and why, drawing on methods such as usability testing, field observations, and interviews. Web analytics reveals how large groups of users have moved through a website, expanding the quantifiable aspects of UX methods from small sample sizes to the entire universe of a website’s visitors.

In practical terms, web analytics allows you to better quantify the portion of your website’s users that exhibit a behavior you have observed during another kind of user research. You can find out how well the number of pageviews of different pages on your website matches the stated interests of the users you’ve talked to. You can find out not just how many of your users formulated their search engine query in some specific way, but also how many people typed similar searches that led them to your website.

About This Book

This book will help you utilize web analytics to answer questions about your users and how they interact with your website. Throughout this book, we will draw upon Google Analytics for examples and will occasionally refer to examples from the author’s work at Pure Visibility, an Internet marketing firm that, among other services, helps clients understand why users visit their websites and how users interact with them. Examples will usually relate to marketing-oriented websites, but the principles discussed in this book will also serve you well if you work on websites devoted to other purposes.

Part 1: Introduction to Web Analytics

The first part of the book is an introduction to key, foundational concepts in web analytics. Chapter 2 focuses on the analysis process itself—an introduction to the mindset of using web analytics. It discusses the importance of viewing data in context, and balancing the desire for perfection against the reality of time constraints.

In Chapter 3 we start to focus on web analytics itself, with an introduction to how these tools work and some of the basic concepts involved. We pay particular attention to ways analytics tools organize and segment data.

In Chapter 4 we look at analytics goals and conversion rates, a way of choosing specific actions users can take on your website to serve as indicators that the website is achieving its aims. Choosing web analytics goals is a process of understanding the purpose of an organization and the role of the website in carrying out this purpose, and is key to organizing and structuring your use of web analytics.

Part 2: Learning About Users through Web Analytics

The next several chapters provide an overview of various analyses you can perform with the data from web analytics. Chapter 5 discusses analyzing the data you gather about users themselves to understand them better. Analysis of these data can provide information about where users are geographically located, what kind of technology they use to access your website, and how often they visit the website.

Chapter 6 is about studying the way users actually get to your website, with most of the chapter focusing on analyzing the words users type into search engines to arrive at your website. Keyword analysis reveals how users articulate their information needs and allows you to categorize users according to their reason for visiting.

In Chapter 7 we focus on exploring how users interact with the pages on your website, through analysis of metrics that record things like how many times users view a page and how long they spend on the page.

Chapter 8 delves into click-path analysis, a specific way of studying how users behave by following their journey from page to page on your website. Click-path analysis is challenging because of the diversity of behavior that you will almost certainly see on your website, but examining the relationships between pairs of pages can point to potential problem areas.

Chapter 9 introduces segmentation, a powerful way of filtering data that can produce answers to more complex questions. Up to this point, we will have worked with data about the entire population of users or about every user with a single shared attribute. Segmentation lets you isolate data about users according to multiple attributes so you can analyze the behavior of users who fit specific profiles, such as users who look like your website’s primary persona. It is key to answering complex questions about users.

In Chapter 10 we look at ways you can integrate web analytics with traditional UX methods like usability testing and personas. The process is fully reciprocal: studying web analytics can raise questions about users that you can then try to answer through other research methods, and you can also take findings about your users from small sample studies and learn from web analytics data how well those observations reflect the larger population of your users.

Chapter 11 is about using web analytics to test the effectiveness of design changes on your website. The basic mechanism for doing so is isolating aspects of user behavior you wish to change, and comparing data from before and after the design change to assess the effect on user behavior.

Part 3: Advanced Topics

Part 3 is a sequence of chapters dealing with topics beyond the core functionality of web analytics tools. Chapter 12 looks at ways to measure user behavior within pages rather than movement from page to page, which often requires adding more trackin...