By David Schneer, Ph.D.
12-Minute Read
“The mind is like an iceberg. It floats with one-seventh of its bulk above water.”— Sigmund Freud
Qualitative research has always been built on a single, audacious premise: that if you listen carefully enough, people will tell you the truth. Not necessarily with their words—but with their hesitations, their contradictions, their body language, the things they almost say before pulling back. For more than a century, the practitioners of this discipline have refined the art of reading between the lines. And yet, for most of that history, the tools we’ve used to do it haven’t changed all that much.
Until now.
We are living through what I believe is the most significant transformation qualitative research has experienced since its founding. The convergence of nonverbal intelligence and artificial intelligence in applied qualitative behavioral science is fundamentally reshaping what it means to listen. And those of us who’ve spent decades in this field have a choice: we can cling to the methods that got us here, or we can lead the discipline into its next era. I vote for the latter.
To understand where we’re going, we need to understand where we’ve been. The story of qualitative research is richer—and stranger—than most people realize.
The Psychoanalytic Root: The Freudian Connection
Let’s be clear. Sigmund Freud never moderated a focus group. He never sat behind a one-way mirror or drafted a discussion guide. Nevertheless, his DNA is all over qualitative research.
In the 1890s, Freud developed a set of techniques—free association, dream interpretation, the analysis of slips and resistances—designed to access what lay beneath conscious thought. This insight is still the foundation of every qualitative study conducted today. When a respondent in a focus group says she “loves” a product concept but simultaneously crosses her arms, breaks eye contact, and flashes a micro expression of disgust, we’re operating in Freudian territory—the territory of the unconscious signal.
This observational instinct—the conviction that surface behavior conceals deeper truths—that was the gift he gave to qualitative researchers.
Merton, Lazarsfeld, and the Birth of the “Focused Interview”
The leap from Freud to the research facility occurred in the 1940s. Robert K. Merton, a sociologist at Columbia University, was collaborating with Paul Lazarsfeld on a government project studying the effectiveness of wartime propaganda. They needed to understand how audiences reacted to radio broadcasts and training films—not just whether they liked them, but why certain messages landed, and others fell flat.
Merton’s solution was what he called the “focused interview.” He assembled small groups of people who had shared the same experience—in this case, listening to the same broadcast—and guided them through a structured but open-ended conversation about their reactions. The method was designed to surface subjective experience in a way that could be systematically analyzed.
When Merton published The Focused Interview in 1956, he gave the field its first rigorous methodology. This was no longer therapy. This was market research. The questions were planned. The facilitation was intentional. The analysis was meant to produce actionable understanding, not personal healing.
Dichter and the Motivational Turn
If Merton built the structure, Ernest Dichter furnished it. A Viennese psychologist who emigrated to the United States in 1938, Dichter is often called the “father of motivational research,” and he earned the title by doing something no one else had thought to do: he took Freud’s depth psychology and pointed it directly at consumer behavior.
Dichter’s work in the 1950s and 60s was electrifying. He convinced Procter & Gamble that soap was about purification rituals, not cleaning. He helped automakers understand the sex appeal of convertibles and the family comfort of sedans. His methods were deliberately provocative—projective techniques, symbolic analysis, deep one-on-one interviews that lasted hours.
Dichter, however, would be vilified in Vance Packard’s 1957 book, “The Hidden Persuaders”—framing motivational research as corporate mind control. The blowback was so severe that the industry tilted toward the safety of quantitative methods for the next two decades.
But Dichter’s lasting contribution was the idea that qualitative research could deliver insights that numbers just can’t. He proved that understanding people’s decisions requires going beneath the surface—and that doing so has enormous commercial value.
The Golden Age of the Focus Group (and Its Limitations)
By the 1970s and 80s, the focus group had become the default instrument of qualitative research. Purpose-built facilities sprang up in every major market. The format standardized: eight to ten respondents, two-hour sessions, a moderator with a discussion guide, clients watching from behind the mirror, with the cameras rolling. It was efficient, scalable, and endlessly repeatable.
It was also deeply flawed.
Forget for a minute that focus groups have been one of the most misused methodologies (i.e., using them for evaluation when in-depth interviews would be more appropriate), the traditional focus group was designed to capture what people say—and it did that well. But it was never designed to capture anything else: the micro-expressions, the postural shifts, the bodily movements that reveal the gap between stated opinion and actual feeling. Moderators who were trained in group dynamics and questioning techniques rarely had equivalent training in nonverbal behavior. I say this not to dismiss the work that was done during those decades—some of the best qualitative research in history happened behind those mirrors—but to name a structural limitation that the industry mostly chose to ignore.
We were listening to half the conversation.
The Digital Disruption: New Channels
The internet era brought online communities, bulletin board studies, mobile ethnography, and eventually the wholesale migration to video platforms. Like gasoline on fire, COVID-19 accelerated what was already underway, and by 2021, virtual qualitative had gone from novelty to norm. Suddenly, respondents were on Zoom, framed from the chest up, lit by laptop screens, performing for cameras in their kitchens. The industry celebrated the efficiency gains: no travel, faster recruitment, broader geographic reach, lower costs. All true.
But digital disruption gave us new channels for qualitative research. It did not solve the fundamental problem of relying on human words alone.
The AI Inflection Point: Where We Are Now
This is the moment where the story changes. Over the past several years, artificial intelligence—particularly in the domains of emotion recognition, micro-expression detection, and behavioral pattern analysis—has matured to the point where it can serve as a genuine analytical partner in qualitative research. Not a replacement for the researcher. A partner.
Here is what that looks like in practice. At Merrill Research, we now run qualitative studies where AI is operating in parallel during live sessions. While I am following the thread of the conversation, delivering relevant probes, and managing the software platform (if virtual), I am also trained in nonverbal intelligence with the ability to spot differences between the vocal and corporeal. Meanwhile, the AI algorithm is tracking right along with me—recording micro-expressions that last less than a second. It’s detecting incongruence between what someone says and what their body is doing in the one-to-three-second window after a provocative question lands—just like me. It is a belt-and-suspenders approach to keeping your pants up.
The implications are profound. For the first time in the history of this discipline, we can systematically capture and analyze the nonverbal dimension of qualitative data. What was always intuition—the experienced moderator’s gut feeling that something was off—can now be documented, timestamped, corroborated, and repeated. The iceberg that Freud described is finally visible beneath the waterline.
What This Means for the Profession
I’ve spent more than four decades in qualitative research. I’ve watched this industry evolve through multiple cycles of disruption. And I can say with confidence that what is happening right now is different in kind, not just in degree.
The researchers who will define the next era of this discipline are the ones who understand that AI doesn’t diminish the value of human expertise—it raises the bar for what expertise and precision mean. A moderator trained in body language who can integrate AI-flagged nonverbal data into their real-time facilitation is operating at a level that was simply impossible five years ago.
This is qualitative research’s Moneyball moment. The scouts who embraced analytics didn’t become obsolete—they became more valuable. The same is true here. But only if we’re willing to evolve.
The Next Hundred Years
Freud gave us the conviction that surface behavior conceals deeper truth. Merton gave us a methodology for systematically surfacing subjective experience. Dichter proved that depth psychology had commercial value. The focus group industry built an infrastructure for listening at scale. The digital revolution expanded our reach. And now, nonverbal intelligence and AI are giving us the capacity to finally hear what was always there but beyond our perceptual grasp.
Each generation of qualitative researchers has stood on the shoulders of the one before. We are no different. What is different is the magnitude of the opportunity. We are not simply refining existing methods. We are building a new epistemology for empirical qualitative insight—one that integrates verbal, nonverbal, and computationally detected signals into a richer, more honest picture of what people actually think and feel.
For organizations seeking to move beyond surface-level insights and access a deeper, more precise understanding of human behavior, Merrill Research offers a forward-looking approach that integrates qualitative expertise, nonverbal intelligence, and AI-driven analysis. To explore how this methodology can be applied to your business challenges, contact Merrill Research at: https://merrillresearch.com/contact/
__________________________________________________________________________
David Schneer, Ph.D., is the CEO of Merrill Research and author of “BACKBONE: Surviving the Road Less Quantified; Toward a Deeper Understanding of Qualitative Research.” With over 40 years of experience in the field, he is pioneering the merger of body language and AI-powered behavioral analysis into modern qualitative methodology.
Bibliography
Breuer, Josef, and Sigmund Freud. Studies on Hysteria. Translated and edited by James Strachey. New York: Basic Books, 2000. First published 1895 by Franz Deuticke (Leipzig and Vienna).
Dichter, Ernest. The Strategy of Desire. Garden City, NY: Doubleday, 1960.
Dichter, Ernest. Handbook of Consumer Motivations: The Psychology of the World of Objects. New York: McGraw-Hill, 1964.
Merton, Robert K. Mass Persuasion: The Social Psychology of a War Bond Drive. With the assistance of Marjorie Fiske and Alberta Curtis. New York: Harper & Brothers, 1946.
Merton, Robert K., and Patricia L. Kendall. “The Focused Interview.” American Journal of Sociology 51, no. 6 (May 1946): 541–557.
Merton, Robert K., Marjorie Fiske, and Patricia L. Kendall. The Focused Interview: A Manual of Problems and Procedures. Glencoe, IL: Free Press, 1956.
Morgan, David L. Focus Groups as Qualitative Research. 2nd ed. Qualitative Research Methods Series, vol. 16. Thousand Oaks, CA: Sage Publications, 1997.
Packard, Vance. The Hidden Persuaders. New York: David McKay Company, 1957.
Horowitz, Daniel. “The Birth of a Salesman: Ernest Dichter and the Objects of Desire.” Hagley Museum and Library. Accessed 2026.
Pooley, Jefferson. “Fifteen Pages That Shook the Field: Personal Influence, Edward Shils, and the Remembered History of Mass Communication Research.” The Annals of the American Academy of Political and Social Science 608 (2006): 130–156.
Note on Epigraph Attribution
The iceberg metaphor used in the epigraph (“The mind is like an iceberg. It floats with one-seventh of its bulk above water”) is widely attributed to Freud, but its provenance is disputed. According to Quote Investigator, the earliest known use of the mind/iceberg simile dates to G. Stanley Hall in 1898, with attribution to Freud appearing only in 1929. The metaphor is used here because it has become culturally synonymous with Freud’s concept of the unconscious, even if he may not have originated the precise phrasing. See: O’Toole, Garson. “Simile Origin: The Mind Is Like an Iceberg.” Quote Investigator, August 7, 2024.