Qualitative Research In The Age Of Big Data: Why It’s Indispensable
By Rob Hernandez
Every year companies invest billions in data, analytics and technology to better target and predict customer behavior. With increasingly complex MarTech and CRM stacks, many brands are collecting more data than they know what to do with. This has led many marketing and product leaders to incorrectly believe that they no longer need to invest in primary, qualitative research because they think have all the customer data they ever need.
This couldn’t be further from the truth. More than ever, brands need to dig beyond the data to truly understand the customer. Even the largest, most data-intensive company in the world, Google, has said they need to appreciate “the human, the person behind the data” to be successful. Through observational and conversational qualitative research, brands like Google gain more useful intelligence around their data from knowing the context, behavior and emotions that drive customer actions.
As my colleague Eric Bradlow, Wharton School Professor and Vice Dean of Analytics notes, CMOs and their teams need to focus on “better data, not big data. Data collection must be meaningfully tied to strategy.” That’s precisely what qualitative research does: it makes better use of what you already have/know and opens up new possibilities beyond your traditional view of the world to inform strategic decisions.
Getting to better data starts with asking the right questions. Why do people choose your brand and products, and what drives their purchase decisions? Why that place, those people, that time of day? Who isn’t buying your products and services – those people beyond the reach of your transactional databases – and why aren’t they engaged with your company and brand? By investing in qualitative research, companies are able to answer these key questions – and make the data they already collect more actionable and valuable.
With that in mind, let’s take a deeper look at some of the key areas where even data-rich marketers can and should apply qualitative research to maximize business impact.
Better insights and segmentation
Using qualitative research – through direct conversations and/or observation – companies are able to dig deeper to understand what motivates target customers. This type of empathy-led research not only provides new insights, but also important context to better understand data collected about customer segments (and whether definitions of those segments and their motivations are accurate).
For example, companies may have data that shows that a percent of their audience consumes a certain type of media at regular time intervals. This allows the company to understand the customer’s media behavior from a valid, reliable and statistical standpoint, but doesn’t reveal much about who their target customers are beyond the demographics and statistics including which emotional levers to pull to change perceptions and impact behavior.
“Using qualitative research, companies can layer in these critical inputs to create a much more robust, nuanced, and actionable segmentation that goes beyond hard data.”
In fact, many companies think a demographically-driven cluster analysis from existing customer data is the same as an actual market segmentation. While these clusters are useful in pulling groups of people together based on data like demographics and even transactional metrics, they are not built around the needs, values, and other motivations that drive a group of people to action. Using qualitative research, companies can layer in these critical inputs to create a much more robust, nuanced, and actionable segmentation that goes beyond hard data.
Another key benefit of qualitative research in segmentation is developing stories to better understand and relate to the customer experience. Part of any qualitative researcher’s job is to tell stories (based on patterns that emerge from what they’re hearing and observing from consumers) and build a narrative that reveals who these individuals truly are as humans.
Understanding the customer journey
Often, companies rely on existing customer relationship marketing (CRM) data to give them a sense of the customer journey – from initial consideration to point-of-sale and post-purchase reactions. However, CRM data alone only provides a partial picture. In addition to understanding who, where, when and how often customers are engaging across channels along the path-to-purchase, companies also need to employ qualitative research to understand why a customer feels and acts the way they do, and what informs and drives their decisions.
Importantly, qualitative research is the only way to give companies a customer’s own narrated view of their activities and decisions. It also helps “fill in the gaps” in the journey – revealing critical “micro-moments of truth” where a customer reaches an inflection point in their shopping and buying experience that may not be captured in transactional data. In addition, there is a need to understand the experience and journey of prospective customers that are not being targeted – key groups that may hold potential for growth and lie beyond the reach of existing data sets.
“Without qualitative, companies would not have a true sense of their consumers’ authentic experience”
Without qualitative, companies would not have a true sense of their consumers’ authentic experience or be able to impact the journey effectively at key moments in time. Qualitative adds breadth and depth to paint a more complete picture of the customer journey – often delivered with visual impact that can energize entire organizations for more effective activation and socialization of the learning.
Stronger campaigns and communications
By hearing the stories of target customers and prospects and putting oneself in their shoes, companies are better able to learn who they are, how they interact with their products and services, and what delights and frustrates them. In turn, this helps marketers create more precise, effective campaigns.
Given how rapidly the customer journey and needs are evolving, marketers have to constantly question and seek out new data and voice of the customer feedback to stay connected. Qualitative methods and techniques like passive observation, online interactive boards, and social media monitoring, can provide more real-time insight into customer needs and wants. It also yields the all-important context and emotion that creative directors rely on to craft campaigns that truly resonate with audiences.
“Qualitative research helps ‘fill in the gaps’ in the journey – revealing critical ‘micro-moments of truth’.. that may not be captured in the data.”
Interestingly, there is a trend toward companies using data analytics and modeling (like discrete choice or structural equation modeling) to help create positioning and messaging territories. It is no secret that companies tend to place great trust in “numbers” and hard data in developing creative marketing communication campaigns. While big data and related analytic techniques are useful in this application, they cannot be effectively deployed without qualitative research upfront to surface relevant category attributes (typically consumer needs matched with product features and benefits), and importantly, do so in a way that accurately conveys the customer’s own language.
Data analytics alone can never get close enough to the real person to reveal the types of emotions and desires that so often fuel the best creative ideas. Simply put: When we know who we’re talking to, we can craft more compelling messages for that audience, differentiating a brand and driving desired behavior. By applying new insights and learning on an ongoing basis, companies are able to experiment and continually improve campaigns to deliver the right message at the right time to target customers. Great qualitative drives that.
Why this all matters
Observation, awareness, socialization of ideas and psychology all play a role in understanding the world of customers. In addition to data and analytics, the need for observing and talking to people remains vitally important for gaining useful consumer intelligence that will drive business results.
It’s so important to bring the customer’s story to life, to make it relatable, so that it creates real impact in those who make marketing decisions. By relating to the stories of your customers, you better understand them in ways that are meaningful. You have an opportunity to embrace them as part of what you’re building. Companies need to stay open, truly listen to their customers, and invite them to help write their brands’ next chapters. Data alone can’t do that. It takes people – and empathetic qualitative research – to shed light on the nuances of human behavior.
*Note: An alternate version of this article originally appeared in Marketing Profs.