Liquor Privatization Initiative Accurately Pegged by Pre-Election Online Survey

liquorSurvey Analytics is pleased to report that our recent poll of King County, Washington voters called the outcome of the State of Washington’s liquor privatization initiative with a high degree of precision.

Our political poll marks an exciting and innovative, new approach whereby public opinion researchers, public affairs firms, political consultants and political campaigns themselves can cost-effectively and efficiently take the pulse of the electorate.

1183

Back in late October through early November, we invited likely voters residing in King County and Seattle to weigh in on various ballot measures, candidates and other matters. One of the most prominent issues on the November 8 General Election ballot was Initiative 1183, which will privatize the sales and distribution of liquor.

A total of 2,001 likely King County voters took part in our survey. When asked how they would vote “if the election were held today,” 61% said yes and 33% said no, with 6% undecided. In the actual election results, 60% of ballots cast voted for the initiative and 40% against. A match-back analysis of the survey sample suggests that those who participated were closely representative of the King County electorate, in terms of party affiliation, gender and age.

Liquor Chart

Unlike full-blown telephone surveys typically used by pollsters, our unique approach can be fielded within minutes and produce meaningful results within hours. Complete cross-tabulation data and topline results are available immediately. A complete analysis of our survey and its results is coming soon.

Note: For more information on this survey, check out this post on the SurveyAnalytics Blog:  ”Voter Panels – a real-world application in predicting outcomes of voter initiatives.”  

QR Code-Enabled Mobile Surveys: An Example

 

 

 

 

 

 

 

 

 

 

 

[Editor's Note:  this post was originally published on the Survey Analytics Blog.]

My friend Scott Liang from Parametric keeps telling me – the quicker you collect feedback from the Point-of-Transaction, the better the recall and quality is. While I have absolutely no way of verifying his assertion, in todays Blackberry and iPhone induced ADHD world, it seems logical – and anything that passes the sniff test, works for me!

If we accept that premise, then what the Washington State Ferries in conjunction with the Washington State Transportation Commission is doing is pretty innovative — collecting feedback directly from commuters while they are in the ferry. As passengers are commuting in the ferry, they have options for using their smartphones via QR Codes to give feedback on the ride.

Few innovative options:

Thumbs UP and Thumbs Down:

Instead of having just one QR code that takes them to a survey, the Thumbs Up/Down model has 2 QR Codes – each representing positive or negative emotion espoused by the passenger overall. This is similar to the the universal facebook “like” button that we are all accustomed to in the web world.

FROG on Board Poster

Integrated with MicroPanel:

Users who choose to give feedback are then asked to join a panel for future surveys and feedback. This allows the commission to build a long term relationship with the passengers — the commission can then use this panel for pricing, satisfaction and other kinds of research.

Once the feedback was collected, users are given the option to go to the mobile-optimized page for MicroPanel;

Completely Turnkey:

No custom development. This entire solution is off-the-shelf. This reduces cost and complexity. SurveyAnalytics has as question type that supports creating QR Codes. This enables you to create a survey with multiple QR Codes for each option:




click-here-to-download-the-case-study



How Not to Get Market Research Clients

I’ve worked in many roles in market research, but never as an in-house market researcher in a corporation.  I’ve always felt bad for them in that I know they get a constant stream of suitors among would-be market research suppliers.  In particular, at conferences as it appears they’re being accosted left and right by hungry supply-side sales people.

This Tuesday, November 8th, Tiffany McNeil, Strategy & Insights Manager, Innovation at Del Monte Foods was interviewed by Ray Poynter of Vision Critical on Radio NewMR.  She spoke about a number of topics, including how to – and how not to – get on her radar.

Note:  this interview has been lightly edited.  You can listen to the original interview on the Radio NewMR archive page.

Ray Poynter: What would you define as innovation in market research?

Tiffany McNeil: I’d say that, for me, good innovation is one of two things. Besides a general willingness to be sensible and try new things, which is actually one of the great things about BrainJuicer, I know Tom (Ewing) is the other guest today – we work with BrainJuicer a lot – they have a lot of proprietary tools that are trademarked, and those tools are fantastic, but if you have a question that doesn’t fit with one of the tools that they already have in their toolchest as it were, they are more than happy to try and find a new solution for you. And I think that a lot of other companies do have these trademarked tools, and kind of no matter what you ask them, try to shoehorn whatever your question is into one of those boxes. So I think that’s one thing – just a general willingness to be flexible and try things. And the other is sort of a more traditional answer, which is, kind of a better way to answer questions, either faster, more efficient, or maybe even just more engaging, so that when I present back to my internal partners, it’s something that’s more compelling for them to listen to or to pay attention to.

Ray Poynter: OK, we’ve mentioned one of your suppliers, but in general, when you’re looking for suppliers, what are you looking for?

Tiffany McNeil: It’s hard to say. I think that the suppliers who earn – I can’t speak for my company or my team, but for myself. The suppliers that I’m excited to go back to over and over again are the ones that are just great to work with – the ones who, when you call them, there’s always someone really smart and engaged on the other side of the phone, who are really responsive, who do lots of follow-up work without sort of claiming “scope creep” the second you ask a question you didn’t know the first time. And there aren’t actually that many people who fit that mold, unfortunately. There’s a lot of little mistakes, there’s a lot of sort of people who are really engaged when you’re trying to win the work and they disappear once you get it. So we have probably as a group a pretty small list of suppliers who we feel are always consistently delivering excellent work, and good partnerships.

Ray Poynter: So you have a good list, a small list of people – now, please do not everybody contact Tiffany offering your services…

Tiffany McNeil: [laughter]

Ray Poynter: …otherwise we’ll get nobody wanting to appear on the radio show, from the client side – but, what are the good ways of people getting onto your radar? If somebody is truly innovative, how would you like to find out about them?

Tiffany McNeil: It’s a really interesting question. I was thinking about this a lot yesterday. And I think that – how about this? The way not to do it is to call me and leave me a message, or send me kind of cold emails. I get – you know, everybody gets – but I get tons of them every day. And, not only do I not have time for them, but I also have a lot of guilt about them. It’s just not making me feel good about myself. But I think that when we’re looking for a new methodology or we’re looking for a new supplier, typically the first thing I’ll do is ask around on my team. There is a lot of word-of-mouth – people who have worked in other companies, and may have answered a similar question somewhere else and so might have an idea.

For example, I’m working on a question right now, which isn’t something that I’ve done before – the methodology’s going to require some pretty smart analytics, it’s going to be kind of analytically tough. So in my head I go through the roster of companies that fit that mold. So, you know, who do I know that’s really smart about analytics, and if I come up short, the next thing is I kind of walk around and ask everybody on my team. If I fall short there, I’d say I probably look to thought leadership next. So, Vision Critical is a good example. They are a company that I didn’t really know anything about, and we don’t use them – we do have a relationship with them now, but the way they got on my radar is two things: they showed up at the conference that Lenny (Murphy) chaired last summer – the NewMR new methods conference – but before that, I had gotten a piece of mail that was a list of the top – it actually wasn’t from them – I think it was either from BrainJuicer or from Synovate – one of those two – were also on the top of the list, but Vision Critical I think was top – and it just stuck out as a company that we don’t know, that apparently people like working with. So, that’s an example of how a company kind of got on our radar – now, frankly, we haven’t done any work with them, but I had a conversation with them, and I kind of feel like I know what they do and what they’re good at. And if the right question came up we would reach out to them proactively.

Ray Poynter: Super – and I think probably the list you’re talking about was a thing called GRIT, which is a study that GreenBook run in conjunction with lots of other people, and it has got some interesting questions in there, “Who do you think is innovative?” and yes, BrainJuicer do very well and a number of other companies do very well, including some of the large ones, which I think was an interesting part of that. I’m going to change tack now, and Tiffany, thanks for that, and I hope you don’t receive even more emails especially now that you said that’s not the way to reach you.

Here is Tiffany’s biography:

Tiffany McNeil is a client-side research manager whose circuitous career path brought her most recently to a Strategy and Insights role in the CPG world. Before that, she spent time in New York and London, where she worked primarily in the television industry, including content and editorial research roles at UKTV and Channel Five in London. She is passionate, smart, and opinionated – um . . . and modest charming, but she wrote this herself, so take that how you will. She lives in San Francisco(ish) with her family and spends most her time making lists.

How Much Should Market Research Cost?

market research pricingHow much is market research worth? How much are insights worth? How much are insights that will make a difference for your business worth?

These are all questions that are on the minds of many in the market research community.

Recent economic challenges have made it more and more difficult for clients to justify spending money on a range of outside services – and market research is certainly no exception.  This dynamic has accelerated a trend in recent years toward downward pricing pressure on market research services.

Professional supplier-side researchers have sought for years to explain the value of market research, and, importantly, arm their brothers and sisters in corporate market research departments with justifiable explanations of the return-on-investment of their companies’ research expenditures.

Some have suggested that a radical, results-based model should be instituted; that research agencies’ compensation should vary depending on the economic value created by the insights provided.  There are serious hurdles, of course, to implementing that sort of model.

In a recent post in GreenBook Blog entitled “Should Research Agencies be Paid for the Value of Their Insights?”Edward Appleton concludes after an interesting review that “insights in whatever form or shape, however delivered, will remain extremely value for the foreseeable future, and market forces will answer the value question for us.”

Technology – the culprit to some, the savior to others – has undoubtedly encouraged a trend toward commoditization of market research.  The starkest example of this trend is in the online sample world, where per-respondent access to female primary grocery shoppers has gotten microscopically low, and even B2B decision makers can be found for a bargain if you know where to look.

This blog’s sponsor, Survey Analytics, is a proponent of commoditization in the research arena.  The company’s do-it-yourself software is, with others, part of the trend toward “faster/better/cheaper.”  Indeed, the company recently announced the first-ever flat rate pricing for creation of custom market research panels.

As it has done in so many industries, technology empowers the consumer.  In this case, the consumer is the corporate market researcher – the consumer of insights, as it were.  Technology has allowed them many new choices.  Ultimately, as they are at the top of the purchasing chain, they as a market force will decide which technology, which people and which companies create value for them.  And it makes no difference whether that idea makes research suppliers uncomfortable.

Virtual Market Research Event Kicks Off Year Two This Week

NewMRBy the time the Festival of NewMR reaches its tenth anniversary, the novelty of online-only conferences may have worn off.  But it hasn’t yet.

Such online-only events are increasingly becoming part of the market research thought leadership scene, with entries in the past year from the American Marketing Association (AMA) and Market Research Global Alliance (MRGA).

While online-only conferences lack the appeal of traditional face-to-face interaction, they offer the advantage of allowing researchers who cannot travel to attend conferences the opportunity to participate, both as presenters and participants.  Online conferences open up the conversation beyond the “usual suspects” who attend multiple research conferences each year.

In year two of the Festival, last year’s organizer, Ray Poynter, who recently accepted the position of Managing Director UK with Vision Critical, has been elevated to Festival Chair, while last year’s deputy, Sue York, serves as this year’s Festival Organizer.

This year’s event is more even more ambitious than last year’s inaugural event.  The conference has activities all week from October 31st through November 4th.

The meat of the Festival is the so-called “Main Stage,” a twenty-three-hour marathon on Thursday, November 3rd.  Other activities include a Young Researcher Competition, a Training Day, and an Insight Innovation Competition.

This year’s Main Stage is comprised of seven consecutive sessions, spaced at three-and-one-half hour intervals.   A single registration is required for attendance at as many Main Stage sessions as desired.  The presentations chosen for the Main Stage were selected by online vote.

See below for the full November 3rd Main Stage program.

Poynter will be speaking to kick off Session 3 of the Main Stage at 7:30 a.m. Greenwich Mean Time on Thursday, November 3rd.  His topic is “NewMR, a View of the Next Two Years.”

NewMR previously used Ning as its website technology of choice, but this year they have switched to WordPress, which does not require users to register for membership.  The Main Stage program is being delivered via GoToMeeting technology.   

Principal sponsors of the Festival of NewMR include Survey Analytics (Silver), GreenBook Blog (Media), ESOMAR (Bronze), ASMRS (Bronze) and Q Analysis Software (Bronze).  If you are a “member, supporter, customer, or fan” of a Festival sponsor, you can attend the Main Stage at half price.  Sponsors also are contributing to an innovative e-Exhibition page on the NewMR site.

We hope to see you at the Festival of NewMR!

FESTIVAL OF NEWMR
Main Stage Schedule
Thursday, November 3, 2011

Session 1 – 00:00-02:00 (GMT)

Jeffrey Henning, Affinnova
Crowd-Shaped Surveys: Adapting the Experience Based on Prior Respondents

Annie Pettit, Research Now
On Social Media Research

Alastair Gordon, Gordon & McCallum
Surveys Without Scales – NewMR and Facial Imaging

Victoria Gamble, WorkINProgress Qualitative Research
Taking Qualitative Online: What I wished I’d known before I started

Session 2 – 03:30-05:30 (GMT)

Mike Sherman and Neil Gains, SingTel and Tapestry Works
Less is More: Getting Value (Not Just Reams of Data) From Your Research

Sue Bell, Susan Bell Research
How to use discourse analysis in market research

Christine Walker, Alliance Strategic Research
2011 What a Disaster!

Jess Whittaker and Steve Nuttall, Buzz Numbers and Colmar Brunton
Are social media and research meant to be together?

Session 3 – 07:30-09:00 (GMT)

Ray Poynter   
NewMR, a view of the next two years        Vision Critical

John Griffiths, Spring Research
It takes two baby!

David Penn, Conquest Research
Neuromania and why we need to re-humanise research

Session 4 – 10:30-12:30 (GMT)

Mark Earls, Author of HERD
Less is more: how pattern spotting can save us from ourselves

John Kearon, BrainJuicer
Let’s Get Emotional About Advertising; Evidence from the frontiers of behavioural economics about how ads really work

Rosie Campbell, Campbell Keegan
Case of the Dead Cat:  Curiosity not to Blame

Ian Ralph, Marketing Sciences
The Rise of the Digital Shopper: New ways to shop require new ways to research

Session 5 – 14:00-16:00 (GMT)

Robert Kozinets, Author of Netnography
Anthropology Goes Online: Why Cultural Insights Still Matter

Diane Hessan, Communispace      
Online Communities: Mistakes, Misuses and Challenges

Paul Child, Join the Dots        
Life outside the ivory tower

Felix Koch, Promise Communities
What next? 5 predictions about the future of online co-creation

Session 6 – 17:30-19:30 (GMT)

Finn Raben, ESOMAR
Update on Privacy and Ethics

Bernie Malinoff, element54
The Road to Survey Extinction

Jon Puleston, GMI
The ideas that are transforming market research

Ross McLean, Egg Strategy
Digital Ethnography – Revealing Human Truths through Smartphones

Session 7 – 21:00-23:00 (GMT)

Reg Baker, Market Strategies
Survey Gamification: Old Wine in New Bottles?

Steve Rappaport, ARF
Listening as Foresight: Detecting Emergent Consumer Trends

Leslie Townsend, Kinesis Survey Technologies
2016: A Market Research Odyssey

Leigh Caldwell, Inon
Behavioural economics – new new or new old?

A New Approach to Research in the Public Sector

A recent survey caught my eye, not for the content of the survey itself, but for what it signals about a shift in the way research is conducted in the public sphere.

As it turns out, according to this survey, people favor sick leave for public employees. You’re shocked, right? But the real story is the platform: CityFeedback (full disclosure: CityFeedback is part of SurveyAnalytics, which is run by our senior contributor, Vivek Bhaskaran.) Traditional research and feedback mechanisms, particularly in the public sector (federal, state and municipal governments) have relied on the telephone. Telephone surveys conducted on the part of the government, or telephone calls that citizens would have to place in order to lodge a complaint, make a request, and so on.

CityFeedback leverages more modern approaches to collecting data from residents, including applications for mobile devices, including the iPhone and Android platforms. One of the most significant benefits of such an approach as I see it, beyond the growing preference of electronic communication over making a phone call, is the ability to capture contextual data along with the feedback (exact location, photos, etc.) Now, when a resident wants to report a pothole, they’re report is rich with contextual information that aides the city in their response. Additionally, municipalities are able to conduct more cost-effective, direct outreach to residents, gathering their views and opinions on any number of current issues.

Have you seen this sort of technology put to use in your locale? As a resident, would you want to use tools like CityFeedback to connect with your local government? Share your thoughts in the comments, or find us on Twitter (@researchaccess).

Lessons from Jelli

A few nights ago, I had dinner with Mike Dougherty and Jateen Parekh, founders of Jelli, a company that has brought “social” to radio (full disclosure:  I have invested in Jelli and so have much to gain if they are successful). It’s always great to talk to entrepreneurs and to discern from them what they believe matters. In the case of Jelli, I was very happy to see that topmost in the minds of both the CEO and the CTO is the user-experience. How do you provide a phenomenal and memorable experience to the people who use your product and service? I left the dinner very satisfied that a company I love was on the right track (and my investment was going to multiply!)

On the walk home to my hotel, it occurred to me that Jelli has a lot to teach the market research community.  MR folks are a bit like rocket scientists: they solve hard problems with knowledge and methodologies that are not trivially understood by others. Further, they find beauty in data and find symmetries and structures that are in accessible by others. Good MR people can see data and find intelligence.

But very few help the “guy at the end of the line” see the patterns and beauty that emerges. Very few have the empathy or desire to make real art out of the intelligence.

Ultimately, the user-experience (in all its forms) is about art.

Who is going to step up to create the first MR firm that wins awards for aesthetics and UX?

Are iPads and Tablets redefining enterprise productivity?

I want to share two anecdotal stories around how I came to understand that tablets, driven by the iPad, are not just consumer devices that let my 3 year old play Angry Birds, but rather are finding their way into the enterprise and the small business eco-system.

Montessori School

My 3 year old daughter goes to a local Montessori school here in Issaquah, Washington, a suburb of Seattle, where I live. The school is pretty well funded and is run by a very progressive individual. This summer, instead of having a paper and pen to check in and check out kids, they had a Dell Tablet – with an app – to check in and check out the kids. I figured – “Huh. Cool!”  So now they can digitally track who is in school and who is out. A few things jumped out to me:

a) The school can now give me the exact date/time when kids are checking in and checking out.

b) The tablet itself is portable – so as parents are picking up the kids, the teachers hand over the tablets to the parents right in their cars.

c) Multiple tablets can be used in parallel.

All this was achieved with 3 or 4 simple Android-powered Dell Tablets.  No custom hardware or software. Well ok – someone had to write a custom app for Montessori checkin/checkout with a 4 digit pin et al. Being a geek myself, I can see writing an app like that not being a particularly daunting task.

Here is the punch-line: they can now (and they did) automatically bill me for late pickups! It’s all recorded!

iPads in Hotels

I was in Florida for a business meeting and was staying in a mid-market hotel in Tallahassee. They used an iPad for self-service check-in and checkout. No need to stand in line. They outfitted 3 iPads kiosk-style and had a custom app to focus the user experience. Being the geek, I played around with it. It did it’s job. Now compare that to the cost/structure involved with putting in dedicated consumer-facing devices – for example, the airline self-checkin systems. These are not cheap – but the mid-market hotel chain using low cost/commodity hardware and software was able to deliver the same user experience and efficiency that airlines deliver after spending millions on their Diebold systems.

Both these experiences have had me thinking about the tablet as something much more than just a entertainment device for the consumer.

How have you seen tablet devices used in the enterprise space? We’d love to hear more examples. Post your comments here, or send them out on Twitter (@researchaccess).