EmergeSmarter Blog

Do Not Let Your Research Suffer from Decision Fatigue

Posted on Thu, Sep 22, 2011

By Robert Relihan, Senior Vice President

If you have conducted focus groups, or even observed them, you have probably noticed that the energy level can vary over the course of a day.  I have always taken this as the normal course of events. But, it turns out there is a rather interesting explanation for this ebb and flow — decision fatigue.  A recent article by John Tierney in the New York Times, “Do You Suffer From Decision Fatigue?,” describes the research surrounding this phenomenon in great detail.Online Qualitative

I had always thought people simply get tired during the course of the day, but Tierney demonstrates that the mere act of making decisions wears us down, making us less able make additional choices.  He points to a study in which individuals who simply review material were better able to make choices about it at the end than those who were forced to repeat incremental choices. 

He also notes that those who receive food make better decisions.  And, it is not the psychological reward of the food that works.  Tasteless, but sugared grub will have more effect than a sugar-free sundae.

What is the impact of decision fatigued?  One makes poor decisions, of course.  But, what is a poor decision?  The fatigued person defaults to the familiar, the usual, the expected.  In other words, he or she avoids making the hard choices — just those choices we would like research participants to make.

So, what is the lesson here for researchers?  Well, I am going to take the cans of Pepsi and cookies on the table much more seriously than I have in the past.  I might even ban water and diet beverages.  On a more fundamental level, it has caused me to re-think the number and nature of exercises I ask people to perform in a focus group.  Let them create a collage at home rather than force them to select pictures for a collage during the interview.  Might there be implications for questionnaire design?

Concerns about decision fatigue also make on-line qualitative and MROCs look all the more promising.  Participants can respond to our tasks at the times they are freshest and best able to evaluate whatever it is we wish them to judge.

There is another troubling issue Tierney raises.  “Decision fatigue is a major — and hitherto ignored — factor in trapping people in poverty. Because their financial situation forces them to make so many trade-offs, they have less willpower to devote to school, work and other activities that might get them into the middle class….  A trip to the supermarket induces more decision fatigue in the poor than in the rich — because each purchase requires more mental trade-offs.” At first this seems like an important, but a political concern.  Yet, it has implications for those who wish to understand the behavior of consumers.

Dan Peck’ Atlantic article, “Can the Middle Class be Saved?” described what he calls the “hollowing out” of the American middle class.  His economic arguments are familiar. Over the past several decades, a larger proportion of the nation’s wealth has accrued to a smaller proportion of individuals at the top.  But, in the process, the middle class has fractured.  Now, the non-professional middle class are more likely to resemble in behavior and attitudes the “high school drop-out poor” than the “college educated members” of the middle class.

The sub-text — many more of those whom we survey or wish to have in our MROCs and focus groups are likely to be in a semi-permanent state of decision fatigue.  Our methods and approaches will need to be much more sensitive to this fact.

Tags: MROCs, market research tools, qualitative research, Online qualitative research

Wizardry of MROCs: A Meaningful Journey

Posted on Wed, Sep 7, 2011

By Shaili Bhatt, Senior Analyst

It never fails to fascinate me how much people will share about themselves online—especially for longer market research studies where typical time constraints are a non-issue and participation is at one’s convenience.  People can be endlessly interested to complete interactive discussions and creative challenges, even if the rewards are not immediately tangible! As qualitative or hybrid qual-quant researchers, we can foster and utilize human curiosity to the fullest in market research online communities (MROCs).

The combination of a longer MROC timeframe and our innate curiosity allows the moderator and the accompanying backroom to set off on a meaningful journey with consumers.  Many of the questions in MROC studies are pre-structured by the researcher, clients (and sometimes an agency or two), yet we make it a habit to leave plenty of room to play, revise, and add new topics.

With MROCs, process-driven adventures excel when they are led with experienced online moderation, including large spoonfuls of strategy, analysis and fun. (Calling Mary Poppins…)Wizardry Online Research

Blossoming the conversation in a visually appealing, fun and organic fashion, with posts ranging from the serious to even silly, is more of a creative endeavor than a task.

Every day, our backroom insights are shaped by the individuals in the community as much as the group at large.  Over time, consumers share and develop the most interesting points of reference, and as researchers, we identify each clue and investigate it.  At any given time, the data is as granular or “big picture” as we need it to be.

What if you could lead a newly formed community on an adventure to explore products they use every day or on special occasions?  What if you could explore their lives to conceptualize products that don’t currently exist?  What if you could craft questions to be so engaging and educational that the community members have fun on this journey (and forget that they are communicating with technology or are in a market research study to get paid)?  What if they could  journal their experiences in real-time every day of the study and follow how other members may be experiencing similar issues, motivations, desires, or loss, communicating these thoughts and feelings with each other?

Imagine the ideas they could share, the products and product substitutes they could seek, and the roller coaster of emotions that we can feel with them, neatly captured online or on mobile devices—in text, pictures, collages and video—day by day. We get to know who they are, individually and as a group, and by the end of it, we are celebrating new insights and Aha! moments along with birthdays, anniversaries, storm survival, holiday survival, new friendships and team accomplishments.

This is the reality at the heart of today’s MROC studiesMROC Online Research Wizard of Oz—resulting in more meaningful journeys, with more individuals coming together to form fully committed, vibrant communities that are brimming with insights and co-creation, with depth beyond anything most capture from a traditional focus group.  At times it can feel like stepping into the land of OZ and emerging with the key to the city.

Are MROCs part of your toolbox? If you’re working with MROCs, please share your story here, and if you’re not MROC-ing and/or if you’re not particularly enthused about this methodology, please share your side of the story too.

Tags: focus groups, MROCs, Online qualitative research

Reality Check: Online Communities Are Here

Posted on Fri, Jun 24, 2011

By Robert Relihan, Senior Vice President

Last week, I saw David Sirota discuss his book, Back to Our Future: How the 1980s Explains the World We Live in Now - Our Culture, Our Politics, Our Everything. His thesis is that, beginning in the ‘80s, American society has become increasingly focused on the individual.  He, of course, used words such as “narcissism” to describe this.  One piece of evidence he offered was that the number of people who were members of a civic organization had almost halved over a 15 year period beginning in the early ‘90s. Online Communities

Well, we have heard this all before; it’s the “Bowling Alone” argument.

But, as I listened this time, my first reaction, probably influenced by all of the online research C+R has been conducting of late, was to think, “Hey, wait a minute.  What about all of those online communities and social networks?  Aren’t communities both growing and proliferating?  Isn’t there lots of interaction among the members of these communities?  Hasn’t our ‘social capital’ merely moved online?  Isn’t the tendency of people to select their own affinity groups a replacement for traditional communities?”

The answer is yes and no.  It is important for marketers to keep in mind the differences between online communities and physical communities when they plan their strategies and conduct their research.

  • Online communities are not physical; they do not have locations.  This observation may be in the category of “Duh.”  But, what does the difference mean?  We conduct surveys that use a “nationally representative sample.”  That sample reflects general population distribution.  Perhaps, it is more important to reflect the density of different self-selected communities.  A traditional qualitative project might be conducted in different markets to achieve a “national representation.”  Might it be better to be in a single market, but reflect different communities — evangelical Christians, environmentalist, and the like — in separate focus groups?  And, most obviously, if online communities are the way people are organizing themselves, shouldn’t we really be talking to consumers online?
  • Online communities are more homogeneous.  Members of online communities consciously select themselves.  They seek members with whom they share beliefs and interests.  And, if that is the case, do my samples of members of these online communities need to be as large as a sample of a physical community?
  • Online communities are more fragile, less stable.  Recent news suggests that Facebook traffic is declining.  There are a number of ways to interpret this data, but the trend highlights the fact that people enter and leave online communities with much greater frequency than they enter and leave physical communities.  I might have confidence in the results I obtained from a well-designed survey of my town for three years.  But, if I were to rely on a survey of an online community, I might want to revisit my results in half that time.

Online communities are the new reality.  They are indeed a rich, focused source of information.  But, a changed world requires changed methods and perspectives, and C+R is prepared to guide you through this new territory.


Tags: MROCs, market research tools, qualitative research, Online qualitative research

Moderators and Clients on Mars

Posted on Thu, May 5, 2011

By Walt Dickie, Executive Vice President

The long strange trip from the facility to MROCs

I’ve been enjoying Robert Markley’s, Dying Planet, a terrific history of the narrative links uniting the Mars of science fiction writers and the Mars of scientists. And suddenly – as I was reading something that Michael Malin, the director of the Mars Orbital Camera (MOC) team for the Mars Global Surveyor mission, wrote about his difficulties, as a trained a geologist, in doing “geology” on Mars through the medium of images photographed from orbit – I found myself squarely back in the world of marketing research thinking about focus group moderators and clients dealing with online qualitative platforms.MROCs

Geologists think with their senses. They learn a landscape by experiencing it. Malin writes, “For field geologists, the study of an environment depends on hiking around, breaking open rocks, and seeing and touching the ground.” I know this is right; I’ve read a fair amount of writing by geologists over the years. They live to experience what Malin calls the “size, shape, texture, color, pattern, relief” of the rocks. I’ve read more than one geologist talking about licking rock dust left behind after a blow of a hammer. But the reality of what they were talking about just never really hit me before.

Thinking about Malin straining to “do geology” through the fantastic abstraction of a blurry photograph where each pixel represented 1.4 meters of what might have been real, rough rock, hefted and caressed, made me suddenly feel the plight of clients and focus group moderators making the journey from the facility to the world of online qualitative.

Moderators experience the “size, shape, texture, color, pattern, (and) relief” of their data just like geologists, and clients have always shared that experience from behind the mirror. They remember what was said – what was meant – and make connections by remembering the face and manner of the respondent who sat in the third chair to left in the facility in Pittsburgh. Without that experience, and that memory, what she said is all just dry words on a page. Or, text on a computer screen – a “response” to a “probe” in an online discussion. It has “content,” but no taste.

This seems to be one of the biggest challenges for online qualitative right now: to provide that feeling of experiencing the reality of people through the medium of text, pictures, and videos taken out of the physical, touchable context of face-to-face interaction and reduced to an abstract display of “qualitative data.”

But there’s a happy ending to the story of Malin, his MOC team, and geologists as a group. And I think there will be a similar happy ending for marketing research.

Two things have happened for the geologists. First, geology-by-remote-sensing has matured into its own specialty. As the subject matter changed from rocks to pictures of rocks, new analytic methods developed, and both newer and older generations of geologists became comfortable and skilled with them. Malin’s team proved, with their remote pictures of Martian rocks, that there had been active geological processes at work altering the Martian surface in the recent past, something that astronomers had been arguing about for a century. And planetary geology is a hot field at the moment.

The other thing that happened was that re-capturing the field geologist’s perspective on the surface of a remote planet became increasingly possible. The MOC team was working with blurry pixilated images, but they were much, much sharper than the images from earlier missions. And the newer stuff is better still. Although no human geologist has ever experienced the heft of a Martian rock, the Mars rovers, Spirit and Opportunity, gave millions a geologist’s eye view the planet’s surface. It’s telling that the NASA press release for the earlier Pathfinder mission described the Sojourner rover as a “twelve-inch tall geologist.”  

I think that similar advances will happen in marketing research. A methodology for “remote sensing” of qualitative information will mature and both clients and analysts will become increasingly familiar with it and increasingly appreciative of the vistas it opens. And we’ll also get better at capturing the feeling of immediacy in the ways we capture information online and the way we present it.

Just as Mars was simply too good for guys like Malin to pass up simply because it lacked the experiential immediacy of field geology, online qualitative is just too exciting, and the data is just too fascinating to pass up because we’re momentarily feeling the loss of the lady in the third chair to left in the facility in Pittsburgh.

Tags: MROCs, qualitative research, Online qualitative research