What We’re Reading: Sample Size, Mobility, Emerging Practices

Good Monday to you all. We thought we’d start out the week with a list of some of the articles and posts that have most recently caught our eye. Let’s dive right in!
  • How to Determine Sample Size for Segments – As always, Michaela Mora delivers some terrific educational content over at Relevant Insights. In this recent post, she discusses how to go about determining the most effective sample size for individual segments of an audience in order to get the most reliable results. Michaela walks us through the right questions to ask, as well as two possible approaches to take when adopting a sampling strategy.
  • Mobile Survey Response Rates ROCK – Ivana Taylor over at the QuestionPro Blog calls our attention to a recent study in which a mobile response option was added to more traditional data collection methodologies. The results were impressive: 25,000 text message responses were received from 23,500 unique mobile numbers in reply to a single open question.
  • GRIT Sneak Peek: The Top Emerging Market Research Techniques: Our friend Leonard Murphy over at the GreenBook Blog has a preview of the annual GreenBook Research Industry Trends (GRIT) study. The full report will be available in the next week or so, but in the meantime, Lenny takes a look at some of the preliminary data, with a focus on emerging market research techniques in 2011.
What are you reading this week? Be sure to share your favorite articles/blog posts/chat discussions/etc with us, here in the comments or via Twitter (@researchaccess).

Lessons from Jelli

A few nights ago, I had dinner with Mike Dougherty and Jateen Parekh, founders of Jelli, a company that has brought “social” to radio (full disclosure:  I have invested in Jelli and so have much to gain if they are successful). It’s always great to talk to entrepreneurs and to discern from them what they believe matters. In the case of Jelli, I was very happy to see that topmost in the minds of both the CEO and the CTO is the user-experience. How do you provide a phenomenal and memorable experience to the people who use your product and service? I left the dinner very satisfied that a company I love was on the right track (and my investment was going to multiply!)

On the walk home to my hotel, it occurred to me that Jelli has a lot to teach the market research community.  MR folks are a bit like rocket scientists: they solve hard problems with knowledge and methodologies that are not trivially understood by others. Further, they find beauty in data and find symmetries and structures that are in accessible by others. Good MR people can see data and find intelligence.

But very few help the “guy at the end of the line” see the patterns and beauty that emerges. Very few have the empathy or desire to make real art out of the intelligence.

Ultimately, the user-experience (in all its forms) is about art.

Who is going to step up to create the first MR firm that wins awards for aesthetics and UX?

Fundamentally Speaking: Back To The Basics in Marketing Research

In marketing research, we are frequently faced with getting answers faster and for less investment. In the current business climate, we have become all too familiar with the term“doing more with less.” During a recent NY / Philadelphia MRA conference, we heard repeatedly that it is not only the marketing research supplier facing these issues but also client companies and their end users. In the real world, when facing such aforementioned constraints, what might help in delivering on objectives while continuing to provide credible information?

Throughout many aspects of life, we find success by returning to fundamentals. Although getting back to basics sounds obvious, it is often overlooked. When a baseball player experiences a hitting slump, what does he do? He works with a hitting coach to determine if his fundamentals are correct (i.e. stance, swing, mental approach, etc.) The financial markets are no different. Often we read that the financial market needs to turn to fundamentals in order to back on track or grow. CEO’s of large corporations often mention that their respective companies have solid fundamentals. Solid fundamentals translate into success.

In marketing research, returning to fundamentals and applying superior practices can lead to efficiency. Instead of rushing to find answers, we should not lose sight of basics such as what is it we want to learn. The “how we go about it” ought to come later. Simply obtaining information does not serve stakeholders competently.

It is very tempting and easy in the digital world to go online and get information. Digital is built for speed. However, the old adage “garbage in/garbage out” has never been more valid. More information should never be our goal but, instead, meaningful information.Fundamentals in research tie directly back to getting it right the first time. Today there are many resources from which to garner information. Whether we are conducting primary or secondary research, qualitative or quantitative, there are fundamentals that must be deployed in order to capture findings that meet our goals. “Back to the basics” comes down to applying the right resource against what we want to learn. The mistake of placing the cart before the horse is not new.

Successful solutions are not solely about research technique but in applying optimal methodology to yield credible outcomes. Our challenge is not to be induced by the speed associated with the latest and/or so called greatest but to leverage wide ranging knowledge in order to get it right. Poor designs associated with problem definition, sampling frame, questionnaire development, execution or analysis will guarantee dire results. Starting with fundamentals gives us a foundation from which to build a successful project.

[Editor's Note: This post originally appeared on Steve Levine's Blog, and is syndicated here with permission.]

Resources from Market Research University

A few weeks ago, we told you about Market Research University – an all-day, online market research training session run by Kathryn Korostoff of Research Rockstar. The event took place entirely on Twitter; you may have followed along with the hashtag #MRXU.

In case you weren’t able to attend, though, Kathryn and the participating “professors” were gracious enough to have posted some additional resources from the training session:

  • Diane Hagglund, of Dimensional Research, has shared fantastic B2B project management insights here: LINK.
  • Michaela Mora, of Relevant Insights, has shared a generous post on her market research project management tips: LINK
  • Greg Timpany has provided a script of his tweets, here: LINK.
Be sure to avail yourselves of their expertise! This is terrific material, and could be of use to any market research professional.
While you’re at it, you may also want to take a look at another recent post from MRXU contributor Michaela Mora, entitled, “Survey Tools Race to Improve User Experience.” It offers a great look at how online research tools are making major enhancements to leverage developments in new technology (including text selection, heat maps, etc.). Definitely worth a look.

Upcoming Webinar: Taking on the Great Privacy Debate

Privacy exists at the center of the next great debate as the information age continues to evolve. More and more information, especially information of a personal nature, is being shared in public forums (from Facebook and Twitter to shopping profiles to market research studies and more.) But as more information is shared, even though it’s most often done so voluntarily, concerns arise about how that information will be used, stored, protected, and potentially shared with others.

Ray Poynter discussed this in a recent post in advance of the NewMR Festival, and our friend Leonard Murphy has discussed this issue at length on the GreenBook Blog as well. Fortunately, they’re coming together, along with other industry luminaries, to host a public debate on the topic, and hopefully help to answer some of the key questions involved in handling issues of privacy in the era of social media.

Here’s how you can participate:
[Read more...]

Determining Price: The van Westendorp Price Sensitivity Meter

Determining the best price for a product or service is a common marketing research question.  I usually start my conversation with a client asking whether their product has all of its features set or if they also need to test a range of features other than price.  If they are testing variable features in addition to price, we start to talk about conjoint (see here for a video on the current state of affairs in conjoint).  However, if they tell me that their product features are set and they just want to look at price, one of the things we’ll likely discuss is the van Westendorp Price Sensitivity Meter (let’s just call it VW).

I was recently corresponding with a colleague (Dave Lyon of Aurora Market Modeling) and the discussions led me to look back at the original VW paper (Peter H. van Westendorp (1976), “NSS – Price Sensitivity Meter (PSM) – A New Approach to Consumer Perception of Prices,” in Venice Congress Main Sessions. Amsterdam: European Marketing Research Society (ESOMAR), 139-167.)  In my conversations with Dave, one of the issues that arose was the way many modern researchers calculate the point of marginal cheapness.  Are most researchers incorrectly calculating VW’s outputs?  What might van Westendorp himself say about this?  How about a little background before going into this point?
[Read more...]

When Research Contradicts Conventional Wisdom

We came across a great post this morning from our friends at Dimensional Research entitled, “When ‘Everyone Knows’ Contradicts the Research.” (It’s actually a post from earlier this year, resurfaced via their Twitter account; follow them at @DimensionalR.)

The all-too-common market research challenge that this post tackles will likely sound familiar to you: What happens when the findings of the research disagree with what “everyone knows?”

This is a perennial issue for market researchers. Conventional wisdom has taken root, research is conducted to prove it true, and the research proves exactly the opposite. Why? The research must be wrong. The survey must be flawed. The data is bad.
[Read more...]

Avoiding Crummy Market Research

I came across a great article last week that I wanted to bring to your attention. The article, entitled “Five Ways to Protect Against Crummy Market Research,” was written by Paul Gillin of The CMO Site, and being written from the perspective of an informed respondent, Paul brought up some great points.

Paul begins by pointing out some of the most offensive questions in a survey he recently received. Here’s his favorite (and mine, too):

Envision a scale with Highest Revenue at one end, and Highest Control of the Buyer Relationship on the other. Where would you put yourself on this continuum? (We don’t have the ability to draw a “dial” so please try to balance your answers on this scale.)

It’s painful just reading that question. And it’s hard to imagine that a market research professional was involved in any way in crafting that question. (If they were, they should be fired.)

Paul points out some of the other systemic flaws in this instrument, as well, and what will inevitably happen next:
[Read more...]

Engagement through Gamification

I wanted to draw your attention to a great slide deck on the subject of audience engagement by means of gamification and game mechanics. Unfortunately I haven’t been able to find associated video of the presentation being delivered, but the slides are good enough to share on their own anyway.

In the deck, the author – Chris McClelland of Epic Labs – walks through the benefits of game mechanics when it comes to audience engagement (reward, status, respect, self expression, etc.), along with techniques that can be used to unlock those benefits.

I’ve embedded the slides below. (E-mail and RSS subscribers may need to click through to the full post to see them.)