MRMW Live Blog – Day Two

3:54 p.m.

Elias Veris of Insites Consulting discussed the use of mobile in MROCs. He said mobile qual gives you an in-depth understanding of the hows and whys; it’s about digging deep. The 21st century method of digging deep is MROCs. MROCs are about engagement and social dynamics, they are longterm and asynchronous, and they are about unsolicited and maturated feedback.

Insites uses gamification to help keep people engaged. They award points, allow people to “level up” if they post enough content, and they give challenges. One example of a challenge given to MROC members was asking them to “prove” their city is cooler than others, which led to a strong outpouring of participation.

Veris said the right inflow at the right time will enrich your online community. It’s about the picture shared, the social pressure (feedback generates more feedback), and the discussion stimulated.

Veris said not all their participants engage via mobile, but mobile participants are more engaged. Mobile is personal and contextual. He said mobile and MROCs are friends with benefits, and different friends ask for different benefits.

3:32 p.m.

Robert Moran of the Brunswick Group spoke about his writings about the future of market research, which draw heavily on ideas taken from futurism.

Moran outlined the 6Ds that will change commerce, and eventually market research:

- Disruption Ethos
- Disintermediation
- Digitization
- Dematerialization
- Democratization
- DIY

He said futurists have two ways to forecast the future:
- the incremental approach – create the baseline forecast, the “official future,” then bend the official future in a number of different directions.
- the stretch scenario approach – take the top two uncertain drivers and create a two by two matrix

Moran then gave sample of “Toffler-esque future shocks” in market research. The first two, Moran said, are inevitable.

- moving beyond the survey
- the growth of the emerging markets

The others are:

- Data abundance
- Asking-observing shift
- Democratization
- Convergence
- Strategic imperative

Moran’s writings pose 22 possible market research futures. Three examples are:
- Power to the people – the rise of co-creative design communities
- Portal power – all data is consolidated into dashboards, which becomes the most important real estate in market research
- E-agency – market research firms are replaced by individual e-lancers

During the Q&A session Moran said we should kill the term “market research” and start over, perhaps crowdsourcing an alternative.

2:16 p.m.

Rebecca West of Civicom presented a case study of qualitative mobile data collection in a study about stroller purchasing. The respondents reported at the point of purchase via audio and text. Audio comments were transcribed and analyzed. Photos were also shared by the respondents, and those photos were assocated with the relevant text. There was extensive coding of the text responses. The audio responses were seen as particularly valuable by the client.

The stroller manufacturer got several key insights from this study, including the positioning of a celebrity endorsement, the need to market to men as well as women, and the need to explain the value for the substantial price. None of these insights came out in an associated quantitative survey.

1:52 p.m.

David Brudenell of PureProfile gave a case study if his company’s collaboration to create the Reputation Index for Australia’s major banks. Executives’ bonuses were tied to brand reputation. The incumbent was only collecting 1,000 completes quarterly. PureProfile collects a big sample size of 36,000 per year, with 4 weight sets applied daily, weekly, quarterly and yearly.

Brudenell advised that understanding why to innovate will help you understand how to innovate.

He quite dramatically displayed a message on a grave stone saying that the traditional market research value chain is dead. He added that data collection and analysis premiums are gone, that traditional market research skills are hard to fit into new technology. At the same time, the age old pressures still apply – speed and quality.

Brudenell presented a checklist to follow when creating an innovative product. This checklist was used when creating the Reputation Index.

- find a big data source
- apply old school rigor
- link data to everything possible
- collect meaningful data in modules
- automate it
- syndicate it
- make it sexy for customers

1:28 p.m.

Mikhail Zarin of Mobiety and Artem Tinchurin of Tiburon Research presented data from a test of mobile research done in Russia. Mobiety is a Russian-based DIY tool for mobile web-based surveys. Tiburon is a data collection company with access panels in Russia.

Zarin gave some statistics about internet and mobile in Russia: 67% of Russians are online; 20% of Russians surf the mobile web at least once a month; 84% of Russians have a cell phone; 34% have a cell phone only; and half of 12-24 year olds have mobile access.

There were 5 conditions:
“Mobile CATI” – voice interviews on a mobile phone
“CAWI access panel” – WAP surveys to members of an access panel
“SAWI access panel” – Smartphone surveys to members of an access panel
“SAWI river” – Smartphone surveys where respondents were invited to participate in the study at mobile top-up boxes, which are quite common in Russia (approx. 180,000 in the country).
“SAWI spam” – Smartphone survey among people on a (legal) mailing list but who were not part of a panel.

Response rate was much higher for the mobile CATI condition (52%); it was lower for CAWI and SAWI using access panels (30% and 20%), and it was much lower for SAWI river (2%) and SAWI “spam” (0.3%).

Key findings:
- representativity doesn’t exist, but rankings tend to match
- “spam” is bad; even if it is legal the sample will be biased
- SAWI access panel – workable but noticeably biased toward more affluent and active users
- SAWI river – technically works but needs further research

11:48 a.m.

Guy Rolfe of Kantar moderated a panel on the role of trade organizations in the new market research paradigm. Here are some nuggets of wisdom from that panel.

- Mike Cooke of ESOMAR indicated that the most important role for a trade organization is to represent the common interests of researchers legislatively, importantly including respondent privacy issues.

- Tom de Ruyck of BAQMAR said it is critical that organizations work together; for example, it is not necessary for there to be three separate policies for social media. De Ruyck said we are a small industry, and if we do not unite, we will not be able to distinguish ourselves from the marketing and advertising industries.

- Wim van Slooten of MOA said a lot of suppliers do not consider themselves to be part of our industry. Some newcomers are “cowboys” who are not educated on important areas of our business such as privacy.

- Mark Michelson of MMRA said his organization was founded because at the Atlanta MRMW event last year there was a wide-ranging discussion of issues including privacy and there were a lot of participants who do not consider themselves connected to or part of the market research industry.

- Michelson said that the reason market researchers have not developed policies for newer technology-related issues because technology is developing so quickly. It is in part a definitional issue. For example, what exactly is mobile?

- Cooke said we have to regulate ourselves in a real context, not a historical context. The role of government is to protect people, and it is alarming that people are willing to trade their privacy for rewards. We have to make very clear to people exactly what we are doing with respect to their privacy. Not only we but also social media has failed in this so far; people don’t fully understand what cookies are.

- De Ruyck said changing technology alters the way people want to interact with us and brands. The biggest challenge is that we debate all the time without moving forward. Otherwise cowboys from outside the industry will charge forward.

- Van Slooten said there are no standards and no codes of conduct with respect to passive data collection. Engaging in passive data collection without proper privacy considerations is a danger we need to face.

- Sandy Janzen of MRIA said one challenge is legitimizing some of the newer forms of research. We have to usher in new methodologies and educate our members about proper use, while at the same time looking into regulation and legislation.

- Michelson said trade associations’ roles are advocacy, education, community building and standards.

- De Ruyck told an anecdote about how he engaged his students in a market research course in France to co-create a new title for the course. His enrollment had been dipping from 20 to 15 and the students said the course should drop the words “contemporary” and “research.” The new title is “New Ways to Connect with Consumers.” His enrollment increased dramatically to 60 students.

- Janzen indicated we have responsibilities to the public to protect them and look to the future of how new data collection techniques may affect them.

- Cooke said the role of trade organizations is learning from the past and looking to the future. Education is a real opportunity and should be deployed aggressively for the future.

- De Ruyck said trade organizations should be curators of what’s important for members to know.

10:52 a.m.

Anne-Marie O’Sullivan of Qualvu spoke about the power of mobile qualitative video research. This methodology allows insights into real moments in real lives, without having to rely on recall. With the digital revolution, there has never been so much access to rich, real video. When you watch these videos you are absolutely with them at that time, that’s very powerful for researchers and clients.

O’Sullivan quoted Anne Mulcahy, former CEO of Xerox: “We’re drowning in data, yet starving for insights.”

Some clients have indicated current mobile research is quite impersonaal. Researchers need to collaborate with clients to turn mobile data into insights, replicating the scenario in the back room of a focus group where researcher and client collaborate face-to-face. Collaboration must be as innovative and vibrant as data collection.

O’Sullivan also showed how Qualvu’s platform enables coding and analysis of video qual data output. Ways to deliver mobile insights for impact are: present directional highlight reels, collaborate with the client on key themes, plan your report to engage cross-organizational stakeholders, and deliver voice of the consumer in reports.

10:25 a.m.

Aaron Pazurik of Confirmit said we should take inspiration from how marketers approach their subjects. By contrast, only 15% of researchers adjust their online surveys to make them suitable for smartphones. He gave examples of several poorly executed mobile surveys – one which required Flash to be enabled, and another which presented an unsuitably large grid on a small phone screen. He also noted that 65% of senior leaders want market researchers to be a strategic partner, but only 25% view us that way.

Pazurik gave 3 examples of techniques for getting deeper insights with mobile research.

1 – Doctors were given the opportunity to respond to a survey question by a voice-recording. This was quire popular among the respondents and is an example of getting better insights through better survey experiences.
2 – Best Buy ensures that people who express negative opinions or specific problems during customer satisfaction surveys are responded to immediately. This is an example of respecting the value of an opinion.
3 – Legacy, a smoking-cessation company, supplies respondents with a BlackBerry and asks them to record every instance of craving or smoking. If the respondent needs help they are routed to a specialist in smoking cessation. This is an an example of “always-on insights.”

9:53 a.m.

Kristin Luck of Decipher said her company tends to do more WAP than app-based surveys. She indicated the mobile future is about much more than apps and reminded the audience that unlike those present, many people don’t have smartphones.

Luck said researchers need to think about the “blending debate” do you take respondents out who attempt to take a survey on their mobile device, or do you offer the survey both ways, mobile and non-mobile? She has a preference for the latter. If respondents want to come in on mobile, she said, that’s what they’re going to do.

Luck listed some things Decipher has observed about mobile respondents in their surveys: they complete surveys more slowly and they give shorter answers to open-ended questions. However, they showed no clear differences in satisfaction ratings.

She also discussed what she called the tablet opportunity- tablets are particularly well suited for qualiquant investigations.

Luck gave two acronyms for remembering important privacy issues:

OMG – online tracking data, metadata and photos, geolocation
WTF – wandering device IDs, too complex privacy policies, fees for SMS and data streaming

She also gave some best practices: keep surveys short; minimize a non-essential content, and keep the look of the survey simple and minimize distraction.

Luck then conducted an experiment in the room; she handed out traditional questionnaire and asked participants to convert it to a mobile format.

Tips for doing so are:

- limit survey length
- limit total number of pages
- limit text boxes per question to one
- avoid other specifics
- avoid rating scales and grid questions
- when using grids, limit to 3 columns or fewer
- keep column text short
- keep topic to point, limit iterations

9:20 a.m.

Andrew Reid of Vision Critical presented some statistics about the dramatic growth of mobile in India and China and about the dramatic growth of mobile advertising around the world. By 2015 62% of mobile phones will be “smart.”

Vision Crtical runs over 500 community panels, most of which are dual mode (online and mobile). They also run mobile-only communities. Usability is key in mobile.

Reid outlined some key advantages of using mobile in community panels: panelists have already been screened and profiled, allowing shorter surveys; survey field windows can be greatly reduced; clients can get answers in hours; and panelists can participate when it’s convenient for them, yielding better data; surveys can be incredibly targeted; and breakout mini qual groups are possible.

Reid also spoke about augmented reality, which is a live view of a physical part of the world which is supplemented by computer generated data. He said QR codes will soon be like “MC Hammer pants”: something that existed for a short time but was replaced by something much better.

Reid outlined two ideas for how augmented reality could work in market research. In his first example, you start with a community, find out how many have smart phones, profile them, find out who fits in a segment we care about, have them download an app, give them an exercise every time they come in contact with that brand, scan the logo, push the respondent a survey, sync that survey up with the respondent’s deep profile. What we could learn from this is: occasion data, ad recall for the whole marketing mix,, and creating a link beteween encountering ads and brand usage.

He outlined another scenario for package testing, whereby the repondent enters grocery store and is asked to scan a package, then they are delivered a survey “in situ.” This methodology could also incorporate gamification.

8:52 a.m.

Simon van Duivenvoorde of Wakoopa, a passive measurement technology startup, spoke about the effects on privacy of changes in technology. He described the way people consume information by using the example of how he and his girlfriend shop for furniture for their new apartment. They bounce all over the place online, from Facebook to email to Google and beyond. He said there is not straight line anymore when it comes to the way information is consumed. Van Duivenvoorde described this process as “information snacking.” You can have information whenever you want it, however you want it, on the device where you want it.

He said this change makes researchers’ jobs difficult because it is difficult for respondents to estimate their behavior. He gave an example of a study where respondents were asked about their online behavior visiting news sites and that was compared to behavioral information from passive tracking; people estimated their news consumption inaccurately by a factor of two.

Van Duivenvoorde stated pithily that “information snacking leads to data obesity.” An important question, he said, is how do we go from big data to big insights? The change in information consumption forces a fundamental shift in the market research industry; we have gone from not enough data to too much data. The challenge is how to sift through and extract insights from data.

Another question is how we deal with privacy; this is an even bigger issue with mobile because it’s such an intimate device. There has been a shift in consumer perception about privacy. People now understand their data is worth something. In 2008 50% of people would give up their information for something; in 2011 it was 62%. People understand better it’s a deliberate choice, but they want to be in control. These changes force innovation.

8:28 a.m.

Kay Schneermann of Gruner + Jahr presented data from a mobile ad awareness study conducted in Germany. The study included a control group and an experiemental group which was exposed to mobile ads for 4 established brands (Lufthansa, Marc O’Polo, DKV Insurance and Nivea) and one new brand entrant into the German market (Kinnie soft drinks). In each instance there was a significant positive effect in the experimental condition on brand awareness. Among the established brands there was also a positive effect on measures of brand image and purchase intention.

Schneermann’s conclusions from the data are as follows: mobile display ads are noticed and recognized; mobile advertising works for established and unknown brands; mobile advertising even works as a sole channel to produce an advertising impact; mobile advertising promotes the brand image and targeting means greater efficiency; and mobile advertising creates purchase intention.

Areas for future research include qualitative studies and measuring the impact of mobile advertising as compared with other channels.

MRMW Live Blog – Day One

5:29 p.m.

Diane Gardiner of Latitude Insights discussed a mobile qualitative project for Kraft among 4-year olds in Australia. Mobile qualitative research is growing, but there’s a lot of opportunity. Latitude uses mobile qualitative to add more insight to panel communities. They collect ethnographic data such as videos and photos of meal preparations, home decorating, etc. The qualitative study explored kids’ and mums’ opinions with respect to Freddo, a chocolate frog. Respondents were given tasks and challenges over 14 days. One task was to give the child $5 to spend at the supermarket. Another was for the children to select a snack from a “mystery box.” She played videos created by respondents speaking candidly about the product. Benefits include: removing the “researcher effect” with youth research and collecting data in the kids’ natural environment. Clients really valued being able to see the mums interacting with kids in their natural environment. This is powerful material they can show their internal clients. Challenges included: that average consumers aren’t tech-savvy, it is difficult for the researcher to sift through and manage all the videos and photos, and that we’re asking the consumer to be both the researcher and the respondent – there is limited to no ability to probe responses.

5:10 p.m.

Remy Bleijendaal from TNS Nipo said that mobile devices are highly personal and emotional. A lot of businesses want to tap into the mobile circle of trust, but it’s hard to get in because a lot of companies don’t add value. People are online more in the morning and the evening. Mobile’s always connected nature drives “now.” Consumer expectations are raised with respect to convenience and transparency. TNS Nipo did a study among Android users in the Netherlands. People spent 69 minutes per day on mobile apps; social and gaming are the top uses for applications, but shopping and email are done less. Ninety-five percent of the time spent is on apps as opposed to the web.

4:45 p.m.

Dominic Jarville of Research Now described his company’s building of a mobile application. The morning after they activated their iPhone app, 1,900 people had downloaded and installed it with no prompting. He listed some myths about mobile research which have been debunked: that respondents don’t want to take surveys on mobile devices; that mobile respondents don’t take care when completing surveys; that device size matters; that it costs more to reward mobile panelists. They tried a 200-question mobile survey internally; it worked but the user experience was terrible. They consider mobile to be “panel rep,” but not nationally representative. Connectivity continues to be a problem, particularly in US rural areas. It’s not about the app, it’s about the panel too; they do a lot of hybrid studies. Mobile surveys are currently focused on experience; in the future it will be more about measurement.

4:01 p.m.

Florian Tress of ODC Services described a multi-country study his company, a panel provider, to determine how best to create a mobile access panel. ODC profiled its existing online panel in terms of mobile penetration and device details, as well as willingness to participate in mobile surveys and to download survey apps. About half agreed to take surveys on a mobile device. Mobile responents are still far from being representative of the general population, so ODC has a standard modus operandi of combining mobile and online samples. Respondents can decide which device to use. Among those who would not participate in a mobile survey, the top reason cited was cost of an internet connection.

3:40 p.m.

Surag Patel of InMobi, a mobile ad network, gave a case study of a multi-country study conducted in order to understand global differences in mobile media. Respondents were recruited from across the InMobi mobile web and app network. Globally the average mobile web user consumes 7.2 hours of media per day. Thirty-nine percent globally multi-task when watching TV – 71% in the UK, 17% in China. For mobile web users, mobile was the preferred channel for getting information. Fifty-nine percent now see mobile as their primary means of going online – 82% in Indonesia, 26% in Taiwan. When asked why they go online on mobile devices, 45% globally each cited “it’s easy to use” and “it’s always there.” When asked where they go online on a mobile device, 67% said in bed, 47% waiting for something, and 39% when watching TV.

3:18 p.m.

Pankhaj Jha of Millward Brown talked about mobile research in India. He cited a stat that the number of mobile phones in India and China combined is greater than the number in the entire developed world. He also pointed out that 80% of phones in emerging markets are “not smart.” Challenges to mobile market research in emerging markets are poor infrastructure, low literacy levels, and oost sensitivity. He presented a case study about ad testing on mobile phones in India. It was a comparison of of ad testing completed on mobile to traditional paper and pencil. One challenge was balancing the size of the app with the resolution of the video. At the lower end of the spectrum, repondents were watching the video on “smart enough” feature phones. Another challenge was survey navigation – they ended up doing one question per screen, removing the “back” button, adding a “next” button, and adding a progress bar. Responses to the study were “well in line” with the PAPI results. Most of the study was conducted face-to-face as panel and online ad recruitment were more challenging. There was low familiarity with the app download process. Perceived high data costs were another factor causing rejection among some users, on the order of 25%.

3:03 p.m.

Ludger Kesting of Questback outlined 4 phases of research methodology development. Mobile surveys, research apps and location-based surveys are part of Phase 3, which is where we are now. Phase 4 includes multichannel feedback, feedback with multiple devices and context-sensitive feedback. He showed a graphic demonstrating the heterogeneity of mobile devices along a number of dimensions: hardward, equipment, operating system, browers, standards such as Flash and HTML5, internet connections and geograpical differences. He gave an example of the development of QR codes as a link between real world objects and the digital world.

2:21 p.m.

Alastair Hill of On Device Research noted that people keep their phones with them at all times. He presented a mobile diary case study about outdoor media. A panel of consumers in London recorded more than 13,000 individual interactions with brands. They measured the amount of emotion associated with different types of media – radio had the most at 80%, whereas outdoor advertising was at 62%. Online was the lowest amount of emotion at 49%. The stages of the customer journey are: absorbing brand information, planning a purchase, obtaining the product or service and sharing information about the product or service. They evaluated how much of each type of media affects each of those four stages. TV is particularly strong in the absorbing stage. Online is key in the planning stage. He also shared figures on the proportion of internet users in different countries access the internet only through mobile devices – the figure for China was 38% mobile-only.

1:55 p.m.

Jan Schottelndreier of Cluetec talked about how his company helps researchers migrate from paper and pencil to CAPI and mobile CAPI surveys. He shared advice they give to clients. Logistics are critical when planning a mobile CAPI project – such as shipping data collection technology to project locations. For studies conducted outside, environmental factors such as weather, internet access as well as battery life should be considered, as well as the social/economic environment. For studies conducted inside, wifi quality is critical. In some location, such as hospitals and some trade shows, wifi is not allowed. Also important is considering the technical and literacy skills of the target population. Usability is critical. He showed an example of what not to do which is rendering full computer screen rating grid on a tiny mobile screen. It is also very important to choose the right device.

1:37 p.m.

Leslie Townsend and Tariq Mirz of Kinesis presented on doing mobile research in Europe. They project 3G mobile access to be at 90% in Europe in 2014. Kinesis’ research exhibits a 60% response rate on mobile surveys, higher than any other data collection mode. Response is much lower among similar studies in the U.S. In Europe mobile surveys are collected on a wide range of devices, while in the U.S. iPhone is currently dominant with 75% of Kinesis’ surveys completed on that platform. Email still rules and will rule for a very long time for multi-mode surveys.

11:08 a.m.

Siamack Salari of Ethos and Peter Harrison of Brainjuicer presented a case study on mobile ethnography. Respondents were asked to take videos of and commentate on their consuption of food and beverages. Harrison stated that mobile ethnography is in its infancy; there are not experts in it because it’s too young. He also shared instances where data collected were richer vs. poorer.

11:15 a.m.

Edward Appleton of Avery Dennison spoke about the client perspective on mobile. He talked about the fact that mobile is changing people’s lives “big time.” But according to the GRIT Report, only 17% of clients reported actually using mobile research in 2011. Will mobile be THE new thing or A new thing? Mobile advantages include: immediacy, fewer recall issues, shorter surveys leading to higher data quality, contextual richness, greater youth engagement and respondent convenience. Issues with mobile include: normative data include more positive top box scores, richness of self-reported disgnostic data, screen size, user experience and questionnaire length. Appleton also noted that researchers need to translate insights into business advice within the corporation, otherwise we are simply troublemakers. Avery Dennison is actively considering mobile options.

10:53 a.m.

A.J. Johnson of Brainjuicer discussed the model of thinking popularized by Daniel Kahneman, whereby there are two cognitive systems, System 1 and System 2. He described Brainjuicer’s approach which attempts to factor context into decisionmaking. They prefer the term “contextualized research” rather than “mobile research.” He described an experiment about environmental decision factors where the type of music played (French or German) affected the amount of French or German wine purchased. He also described social factors and personal factors (“hot states”). Context changes the way we think and behave. He described a study where they tracked a woman’s emotional states through her journey to a shopping experience and during the experience. They showed faces and asked the respondent to choose which face expresses how they feel right now. Happy shoppers spend about 9% more. Hungry shoppers spend about 8% more. Tired people spend 46% more. The way we feel has a direct impact on the way we behave. Too much current market research ignores context. The mobile device is well-suited to collect in-the-moment context.

10:35 a.m.

Michael Oxfeldt of the Danish Broadcasting Corporation, Reineke Reitsma of Forrester Research and Martin Lloyd of Greenpeace served on a panel discussing the effect of the SoLoMo (social/local/mobile) convergence on marketing insights. Lloyd discussed some of the challenges of being an activist organization operating in China. Reitsma discussed how Forrester is taking mobile into account in how it produces research reports. Lloyd said Greenpeace has studied how mobile technology played a part in both the Occupy movement and the Arab Spring. Reitsma said in the next 5 years, you cannot have a significant presence if you don’t have both a social and a mobile componennt.

9:38 a.m.

Betty Adamou of Research Through Gaming talked about her company’s creation of research games, which she said is a first in the research industry and and a first in the gamification industry. She described a research game created for BBC Magazines’ children’s publications. Children are notoriously difficult to research population. The study was intended to assess advertising and evaluate which celebrities are most influential. Prior to the study RTG conducted focus groups which made it clear that children take information quite literally and that has to be factored in to the design. Response was extremely high – the field period took less than half the allotted time of two weeks. The children made an avatar of themselves and explored a virtual house. The goal was to find stars in the house; each star waa associated with a survey question. There were separate paths for boys and girls. There was a game within the game where respondents had to guess celebrities from pictures which were slowly revealed in stages. Some children came back to play the game after the data were already collected.

9:12 a.m.

Stefan Knect of GfK Nurago talked about the big change in our lives which is the ubiquity of technology. We are always connected. He gave examples of the importance and penetration of mobile technology in the developing world. He said there is no mobile web – there is just the web. There is also no desktop web or tablet web. He said that mobile is taking a bite into traditional media, and that money follows attention, so more money will flow into mobile. He gave statistics indicating mobile’s growth resembles online’s growth 10 years ago. He also talked about the fact that geolocation data is meaningful only in context. GfK’s approach is to measure passively when possible, and if that fails ask the respondent. He said mobile devices are our exobrains. Kids will not know anything other than smart devices.

8:48 a.m.

Mark Melby of Lumi Mobile talked about opportunities to measure instant feedback with mobile. He talked about Lumi’s technology which is for both smartphones and non-smartphone mobile devices. He discussed the importance of usability and gave examples of diary research on mobile where usability is key, including clear icons and simple navigation. He discussed the ability to send push reminders. He said client completion rates and satisfaction scores are impressive. He also discussed passive metering, and gave an example of a panelist, “Molly Bloom,” whom they were able to profile in great detail due to passive metering. Moderator Ray Poynter raised the question of whether changes in technology are simply measuring changes in behavior or are in part causing those changes.

8:32 a.m.

Vivek Bhaskaran of Survey Analytics and Ken Peterson of Ipsos Loyalty outlined the dramatics growth of mobile.  They mentioned the difficulty respondents have in recalling information for traditional surveys.  Mobile allows researchers to collect data at the “Point of Emotion.” Ipsos Loyalty approached Ikea with SurveySwipe to revamp their customer satisfaction research.  They created a mobile panel and cut the traditional customer satisfaction survey to 5 minutes.  The surveys include GPS push notifications of customers when they enter the store.  The surveys also include photo question types.  The surveys give Ikea Immediate Response Opportunities (IROs) where they can respond to issues before the customer leaves the store.  Customer satisfaction scores have been moving up significantly.

Research Access to Live Blog MRMW Amsterdam

Market Research in the Mobile WorldIt’s finally here!

Along with many others, I’ve been looking forward to the Market Research in the Mobile World conference in Amsterdam all year.  The event is set to kick off on Wednesday morning at 7:00 a.m. CEST.

Research Access is a media sponsor of the event, and I will be “live blogging” during both conference days, Wednesday and Thursday.  Check Research Access regularly for real-time updates from the conference.

Here are some of the things I’m looking forward to most in Amsterdam:

Wednesday

- Ray Poynter of Vision Critical serving as chair on Day One of the conference; I only know Ray from his social media and NewMR work, so I’m looking forward to hearing his wisdom in person.

- Vivek Bhaskaran of Survey Analytics and Ken Peterson of Ipsos Loyalty kicking off the conference with a case study of how Ikea implemented mobile market research.

- Betty Adamou of Research Through Gaming giving examples of gamification around the world.

- A panel discussion of the effects of the SoLoMo (social / local / mobile) convergence on market research, with representatives of Greenpeace, the Danish Broadcasting Corporation, and Forrester Research.

- Edward Appleton of Avery Dennison providing insight on the client perspective on mobile research.

- The after-hours event organized by The Research Club (sorry, I won’t be live blogging the party!).

Thursday

- Decipher‘s Kristin Luck giving tips on converting existing studies to mobile.

- A roundtable discussion of the role of trade organizations, with representatives of ESOMAR, MOA, BAQMAR and MMRA.

- A presentation on mobile research in Russia from Mikhail Zarin of Mobiety and Artem Tinchurin of Tiburon Research.

- A session from Elias Veris of Insites Consulting on mobile MROCs.

The world is changing fast, folks. Things that were unthinkable very recently are now possible, sometimes even routine. I’m composing this post on my iPad in the Dublin airport (on a layover en route to Amsterdam). In fact I’m fittingly going “laptop free” for the conference, with only my iPad and iPhone (it’s going well so far, but I’m very glad I brought my Bluetooth keyboard!).

Let me also thank my friend Lenny Murphy of GreenBook, who was slated to chair the conference but had a late change of plans. Lenny, you will be missed in Amsterdam, but you will certainly be here in spirit. Thanks for your tireless work in organizing this conference.

SoLoMo and Market Research

mobile-social-localThank you to all who joined us on March 29th for Research Access‘ joint webinar with GreenBook, “SoLoMo: How Social Media, Localization, & Mobile are Redefining Marketing Insights.”

Here, in all its grandeur, is the text of the full webinar.

The panel included Charlie Rader, Digital Insights Tools Leader, Procter & Gamble; Steve Rappaport, ARF Knowledge Solutions Director and Author, Listen First!, and Andrew Jeavons, President, Survey Analytics. The session was moderated by Lenny Murphy, Editor of the GreenBook Blog.

Click here to access the webinar video and slides.

Leonard Murphy:  Good morning, good day, good evening, depending on where you are in the world. Thanks for joining us today in the ongoing MRX Ideas series of webinars. That is also our Twitter hashtag, is #MRXIdeas, so you’re welcome to submit questions or comments via the webinar interface, but also please do it on Twitter. So it is my great pleasure to introduce our panel for our conversations today. First, we have Andrew Jeavons, who is president of Survey Analytics. Next, we have Charlie Rader, who is Digital Insights Tools Leader at Procter and Gamble, and then last but certainly not least, Steve Rappaport, ARF Solutions Director and author of Listen First, which is a fantastic book if you have not read it.

We’re going to be talking about SoLoMo, how social media, localization, and mobile are redefining marketing insight, and we can go on to the first question, please. So now, just to set the stage for the audience, this is a conversation between four guys over a virtual lunch, and you’re going to listen in, so we have some questions kind of predefined to give some broad structure to the conversation, but these are just to kind of kick things off, so we may digress. We may not get to everything we want. We’ll certainly make sure to incorporate anything that you want to know on this topic, though, so I’m going to throw it out there to Steve and Andrew and Charlie. Each of you, give me your take. When you define SoLoMo, based on your experience and background, what do you think about? What does it mean for you? Charlie, why don’t we just start with you and then Steve and then Andrew?

Charlie Rader:  Sure. Well, to say it funny, I would say SoLoMo is – now, I’ll give our audience just a little bit of background. I know we didn’t do formal bios or anything like that, but I tend to be in the product development side of stuff here at P&G, so a little bit of a different take on understanding the marketing aspect to stuff. I’m interested in how folks are using social media and mobile-based technologies. The Lo part isn’t as well-defined for me as we listen to our consumers and what they’re looking for in the products and services that - whether it’s Charmin bath tissue, Pantene shampoo, any of those types of things – but it’s really great – especially with mobile, to be able to narrow what I call the recall gap, that gap between when consumers experience our products and then are able to give us feedback about what they think about that.  So the fact is that on the local side, this is how I’m kind of bringing this definition into being – the local side is these tools give us access to consumers wherever they’re at, and whether that means having mobile-based tools or online-based tools to talk to our consumers, whether they come in for an interview that day, they’re doing some sort of a homework assignment, so to speak, and so it’s very local. They give us some free, qualitative understanding. We can read that and make that the springboard for a face-to-face interview, or it can be regional to global. I think there’s a lot of great pieces to this entire movement as we are able to listen to our consumers, so that’s kind of a little bit on my take on SoLoMo.

Leonard Murphy:  Thank you. Steve, what do you think about it, from kind of the macro view, from the ARF?

Steve Rappaport:  Sure. Actually, I was glad to hear Charlie, because what I did, I had time to actually think through it, and I wrote a definition, so I can give you the current ARF definition of SoLoMo, which may be subject to revision, but it’s about a half-hour old now, because in this world, you have to time and date everything.

Leonard Murphy:  That’ll definitely change 30 minutes from now.

Steve Rappaport:  So anyway, this is my definition: marketing that centers on an understanding of customers and prospects that helps them do what they’re interested in doing wherever they are and whenever they want, so it really conforms to Charlie’s point about the Lo – I mean, the Lo is really wherever a person is. It’s not necessarily a specific location, and not looking at it from the tools perspective, but really looking at it from the marketing perspective and the company perspective, it really is about providing people with the ability to accomplish things in their lives as they would like to, rather than the way that marketers and advertisers might want them to.

Leonard Murphy: That’s a great definition, and hopefully that will now last a little bit longer than the next 30 minutes, Steve.

Steve Rappaport: We’ll have to memorialize it in some way.

Leonard Murphy:  Right, you heard it here first. Andrew, you guys are doing a lot of work, particularly around the Mo piece of things, so what – anything different?

Andrew Jeavons: Actually, the first time I heard the term SoLoMo, I thought, “It’s an opera by Verdi,” but a nice prosaic little acronym. I’m kind of leaning towards Charlie’s definition. I mean, for us, from what we see, from what clients are doing and what they want, this is a sort of mix of technologies that they’re allowing to capture what are starting to the turn the points of emotion regarding any event as a consumer, and so I think the bits that seem to be coming out, the most important are the local and the mobile – there is this huge interest now in all things geolocational with surveys and where people are going, and asking them at that point what they’re doing. I think the social thing probably fits more in the marketing perspective. Then the people also have the ability at that moment to communicate with their social network immediately what’s going on with them, and while I hear often resistance from people saying, “Well it’s very intrusive and privacy and all that,” I think everybody really secretly likes this, I mean, particularly the younger age groups.  I think it is this thing of allowing us to be plugged into what people are doing in many different ways in terms of their social network and their current location.

Leonard Murphy: You know, this leads into our next question. I view all this as convergence, and it’s not just convergence of technologies, also the convergence of our lives in accordance with the technologies, so, digital – the future of all communication is digital. The future of digital is mobile, so we’re talking about, at least for me when I think about it, that there is, with online or social media or mobile, there’s a false separation between those three. They are effectively one thing, and moving more and more in that way, till we have that 24/7 point of experience, the ability to engage with consumers and share that, so for me, when I think about that, that is convergence. Now, that idea has massive implications on the marketing end of things, particularly. It changes the paradigm to almost the Nth degree, which, by default, then has massive implications for those of us who try to help marketers understand the effectiveness of that, so my next question is, what is the impact of convergence on the marketing function? Steve, we’ll start off with you on that. I think, again, you may have kind of a macro view.

Steve Rappaport: Thank you. I had some thoughts about that, and for me, what came up is really the way that marketers think about their customers, and I didn’t have an answer to this question as much as challenges, and there were a couple. I think there were a couple that are worth talking about.

One is the challenge to understand customers and prospects dynamically, because – and probably Andrew can speak to this much better than I can, but the traditional way that companies understand customers is largely through surveys and focus groups and things, where they’re looking at forced responses and sort of historical information about their customers, but the promise, really, of the social/local/mobile is to really understand the data streams that are happening in real time – the signals that people are giving off about who they are, what they’re doing, what they’re interested in, what they’d like to accomplish and so forth.  So the ability to move from sort of slow information – and I don’t mean that negatively – to really bringing together streams of signals that need to be captured, processed, analyzed, interpreted, and acted up on very short time frames and time scales is extremely challenging for the marketers.

The second is the challenge for marketers to view their customers as something other than deal hounds, because a lot of what comes across that I see is really about couponing and hitting people when they’re walking by your store, and all that sort of thing, and there’s an important place for that, but if we do think more broadly about these technologies, the convergence and the ways that people are using them to get on with their lives, there’s really the challenge of understanding this.

One is, how are people using social and mobile? There’s some really interesting work that I came across by Jerry Zaltman and Joe Plummer on sort of the different ways that people view social networks. A lot of us think that social networks are used in one way, but from the users’ point of view, they’ve identified sort of three different segments for the way that people approach social media. One is as a place to do activities. A second is a place where people can be onstage and announce themselves, and then the third is to use it as a campfire, so, assuming that these are useful distinctions – I mean, this is just in our early work – how many of us are really thinking about the different ways that people are using these tools and what they’re using them for, and then using that understanding to help shape and influence the marketing that we do to those folks? In addition something that we’ve seen for a number of years now is that there are new models of advertising that have emerged that succeed, really, the interrupt and repeat model, and that’s where these models are around service, so reducing friction, helping people accomplish things.

Another is providing information on demands so that people can act themselves, and then the third is engagement, so the convergence of all of this on the marketing function is really to challenge marketers to think much more – not only holistically, but much more integratively about these technologies, how people are using them in their lives, what these technologies and convergence mean to people, and then use that as a window to really understanding folks, and then using that to market and advertise effectively, so that’s my answer to the question.

Leonard Murphy:  That’s – thank you. That’s a great impression.

Charlie Rader: Wow.

Steve Rappaport: Well I’m a big picture guy. I can’t help it.

Leonard Murphy:  So Andrew, Steve kind of pointed out that maybe you have a perspective on that. What’s your take?

Andrew Jeavons:  As Steve said, challenge to understand the customers dynamically, and I think one of the big things that I see is in the past, when we worked with surveys and, we had a set of demographics that we’d use because they were convenient and easy, and because they were all we ever had. Now, we get all these data, and instead of saying to me, “Well, how many times did you go to the market last week?” you can actually know that.

And it is a challenge, because we’re going to get a lot more data. We have a lot of data that’s very different from the form of data traditionally used when we use surveys. We can have streams of data about how active people are physically. We can use the geolocation on the smartphones to find that out. We can have all sorts of information of where they’ve actually been and when they’re been there, and ask them things. We can have people taking pictures or videos of what they do and don’t like, and all this is going on now, and so we have a radically different set of types of data, which will lead to different demographic classifications, which will change the image of a consumer quite surprisingly.

I think there’s going to be one of these revelations where suddenly there’s going to be a lot of realization that the way people are seeing maybe traditional demographic methods just don’t work, but it is a big challenge, and I think one of the things that we’re working very hard on, or a lot of companies are, is making sure that there are mechanisms to understand that data at the moment. We get a lot of pictures uploaded, sort of mobile ethnography. You’ve got to work out new ways of managing that, because it’s just different from what we had before.

Leonard Murphy:  Well, so, Charlie, what about the impact of this – we’re talking about marketing, but from a product development standpoint, how are these technologies actually changing the way you think about products that you’re introducing into the market, and how you’re engaging with consumers in almost a co-creation process, and give me some insights that way?

Charlie Rader: Things that we have – actually, both Steve and Andrew hit on a number of points that, as I was thinking through this question, and I’ll take marketing in a much broader perspective, as in how does P&G as a company – we as a marketer, so to speak, look at these things, and then bring it into product development land. Well, the first thing is that in both social and local and mobile, is like, how are we delivering information to our consumers? That is going to be a critical value add, I think, for our consumers. How do they find things out about our particular products? Is that placing QR codes on our packages and saying, “This is how we’re being eco-friendly as far as our packaging materials are going. This is the top – see a video here,” and then sharing those things in a Facebook, Twitter type of way? Information is going to be another layer to the product development, the total product experience for our consumers, I think

Then, of course, as we’re looking in social media or utilizing co-creation platforms, that type of thing where people are much more used to chiming in and helping out in increasing the value of a product, just not to say, “I’ll probably buy this,” or, “I’ll definitely buy this,” but really saying, “Hey, I can engage in what this company’s going to do, and what this product eventually will look like.” I think to drop a name, we’re looking at something like a Quirky.com, where you see normal folks just getting in on how a product is designed, from first ideation to what colors are going to be chosen for the final product? Those types of things are very open.

We’re not quite that open at P&G yet, but the fact is that we’re looking at that type of crowdsourcing ways of engaging with our consumers, people that both like us on Facebook, as well as just standard, ad hoc panel recruitment to get a broader view of things. That’s the kind of thing where lots of these, both big data, as it’s been called, all the time stamps of where you’re at and when it’s happening, to just figuring out how we’re going to be creating apps for folks to learn more about our products.

Leonard Murphy:  Very cool stuff.  So as we think about what everybody has talked about in terms of the revolutions on both marketing channels, product development, research, let’s expand out a little bit and think about, the next two to three years. Let’s all play Nostradamus for a minute. Two to three years out, what do you think the overall impact of this overall model of convergence, of SoLoMo, will have on business as a whole?

So Charlie, let’s go back to you and think about P&G. Where do you see P&G being from – within your area of expertise around product development in preparation for the overall marketing, how do you see it in two or three years out based on these technologies?

Charlie Rader:  I’m sorry, I can’t comment on that right now – I’m just kidding.

[LAUGHTER]

Leonard Murphy:  You have to sign an NDA to be able to discuss it, right?

Charlie Rader: Exactly.

Leonard Murphy:  The vendors are listening.

Charlie Rader: And being recorded too. No, I think it’s certainly no secret. Bob McDonald, our CEO, has said it pretty clearly to market analysts, and certainly within our own company, that we want to touch more consumers in more parts of the world more completely. That’s how we’re going to grow. It’s part of our purpose. It’s inspired growth strategies, and so digitization is one of our key ways of doing that. It’s going to make us more productive by being able to reach out to more consumers in this digital, local, mobile way. We’re going to be able to talk to folks that we’ve never been able to talk to before because they weren’t in the major markets that we’re normally recruit a group from, and I think we’re only going to be increasing in how we’re going to be looking at digital-based research. It’s pretty simple. It’s certainly not what I’d call proprietary by any means. It’s fairly obvious, really, where lots of the market research tools are headed.

Leonard Murphy:  But what does that do, Charlie, to a company like P&G that values norms and trends and historical data for comparison, when both the methodologies are changing as a default, and a lot of the older data, it’s definitely not relevant for some of these new measurement or engagement techniques.

Charlie Rader: That’s a great question, Lenny. I think that the fact is that in the short term, in the next two years, since that’s the Nostradamus here you’re looking at, are we going to stop doing Nielsen BASES studies? No, we’re not going to stop doing that kind of stuff, but I think we’re going to start learning what, like, a Net Promoter score really means to us, and how that relates to purchase intent, so when we’re able to listen to the social media buzz about products in market, we’ll be able to start relating it back to the historical data, but also, as I’ve heard in now the Market Research in the Mobile World last July, it’s not a matter of how we validate this type of data to that type of data. There will be some places where data validation will be there, and I think the fact is that these new channels of data expose us to new consumers, and so if they’re not quite 100 percent validated between this set and that set, I don’t find that unexpected. I find that actually refreshing, because it means that we are probably reaching people that we don’t typically reach. We’re not reaching the professional panelist anymore. In my hopes, that we’re reaching people who really care about our products a lot more so.

Leonard Murphy: Thank you, Charlie. That’s an interesting perspective, and I think it’s going to be a continual piece of the conversation as we go forward within the industry as a whole. Steve, so kind of playing off what Charlie’s thinking, so you’ve been spending a lot of time around the idea of social media specifically as a multi-level tool for marketers, for market research, and a lot of the conversations at the ARF Rethink conference just wrapped up this week that we were both at. That was around trying to figure out, what are the metrics? What are we really measuring? How does it interact with what we know? What does it tell us that we don’t know? Kind of summarize that. What does that look like overall?

Steve Rappaport: Actually, I mean, probably Andrew and Charlie may disagree with me, but it – and it’s not a plug for whatever it is I’m writing next, but –

Leonard Murphy: You can plug, Steve.

Steve Rappaport:  No, no, no. I don’t have…it’s this thing – I don’t know what forms it’s going to take yet – called The Digital Metric Field Guide, and one of the reasons why I’m working on it is because the ARF – I’m sure most everybody’s familiar with it, but we have over 400 members who belong to us, and these are not individuals. These are companies, so Proctor and Gamble is a member, Unilever, Nielsen…the media companies, the research companies, agencies and so forth, and there’s a lot of just uncertainty and confusion about digital measurement, and so I said, “Well, let’s take a look at the way people are reporting it.” Now, this is not necessarily the way that it’s actually done inside of companies like P&G, but – so what I did is, with a small team, we picked out about 80 award-winning case studies. So these were Effie award winners. Ogilvy, which is the ARF research award, IPA Effectiveness awards, Cassies and things, and I’ve been, for the last couple of months, deconstructing them into this.

One is, I’ve been looking at the overall objective for the campaign, then looking at each of the individual campaign objectives, then looking at the metrics that we reported to measure the progress against those objectives, and then relating all of that to kind of a marketing process that I call – that I’ve adapted called “capture, connect, close, and keep”, so the idea here is that I want to be really, really granular and discover, what are all the different objectives? What are – and things, and I looked into measurements, and when it came to sort of especially digital and the social measurement in particular, there isn’t a whole lot of insight there. These – because the measurements so far that I’ve come across are largely about counting, and they’re about activity, and so while they may be helpful in terms of gauging certain things, right, like the growth of a fan base, what is missing so far that I’ve seen is the ability to actually convert metrics to meaningful measurement that measures progress against achieving a business objective in a truly meaningful way, and that’s where there’s lots of thinking that needs to be done and lots of opportunity, and part of what I’ll be doing in this book is trying to lay out a way that we can start doing that, because counting and activity, it’s really hard to know what that means, so when somebody says their fan base has grown by X percent, or they have so many tweets, or this, that, and same, so they’re really not getting at the business performance. They’re just measuring what is flowing from some of their activities online.

So that’s an answer to that question, Lenny, but I also wanted to add to this part of the discussion that in addition to the discussions that we’ve all had about signals, I think that we’ll also be looking at data coming from new and completely different places, especially when we think about like P&G has their billion new customer objective, and many other companies are looking to grow into truly emerging markets, so when you think about Latin America some countries and locations there, Africa and parts of Asia, much of the data that exists in more developed markets doesn’t exist there, and I think that we’ll be looking at bringing in data streams that are very non-traditional. For example, you may be familiar with the project at the UN called the UN Global Pulse, and what they’re looking to do isthey’re analyzing data from, say, cell phone companies, and they’re looking to see what are the trends in types of phones? What are the trends in types of plans? What are the patterns in the calls and things? Not to identify people individually and not to identify each individual company, but to begin to understand the patterns of communication, among them, the rates of growth and things, because they’re using these as indicators of economic development, consumer interest and such, so one of the things that we’ll be looking at in the years ahead is drawing upon very non-traditional forms of data that relate more to the transactions and the business activities of companies, and in addition to the kinds of data that we’ve worked with for years and years.

Leonard Murphy: So we start going there, and we’re thinking about – at least in my mind, it brings up the ideas around big data, and  if convergence is about the data streams coming together, big data becomes the method by which you try and analyze it and derive value from it, so how does that idea, that the converged data streams are then analyzed through both traditional and nontraditional techniques, and what does that do to the marketing organization, their ability to really deliver impact across their company?

Charlie Rader: Talk to the geeks, Lenny.

Leonard Murphy:  Andrew, you’re pretty quiet. You want to take a stab at that?

Andrew Jeavons: I agree, really, what Steve’s saying, and that’s just really where it’s going. I think there’s going to be a real change – we’re going to suspect that in the past, the idea of recall was fairly shaky, because we’re getting much more closer to the point when consumption events take place, and getting feedback at the point, or comment that we may never have got before, and I think there’s going to be the dreaded baseline shifts in all sorts of research, as snippets of information come out from mobile research, which really does give a different view of the consumer and what they’re doing. I really believe that.

Now, the convergence things and the data streams, well, tthis is great. This is a problem because we really don’t have the analytical tools at the moment up to speed. If you go out and look into the big data world, which I occasionally go and look at because of past obsessions with data, you see all sorts of complaining about, “Well, we can’t kind of run what we want to run with this, that, and the other,” and all this is tech stuff. It actually really important for live virtualizations, that they can do the sorts of analytics that they need, and we run again this thing – we’ve got all this data. It’s great. How are we going to manage it? How do we manage 10,000 pictures of a supermarket shelf that somebody didn’t like? We’re going to get that, so it’s a huge challenge, but as Charlie said, us geeks are going to fix it sometime.

Leonard Murphy: All right, well, Charlie, you got the shout out. I know that – it’s too bad that we didn’t get Mark Lloyd on here with us too, Charlie, because we had a conversation in Cincinnati recently about P&G, for instance. They’re sitting on tons and tons and tons of data that’s very siloed, and the goal, I believe, is trying – as it is for all companies, at this point – o bring those silos and bring all that data together, and try and drive that for insight, so how does that fit into things from your standpoint?

Charlie Rader: Well, I mean, just as we mentioned before, it is how we’re going to be bringing in all those different types of data streams and deriving meaning out of it. Those types of analytics products are going to start turning things around. It will no longer be, when it comes to the marketing world, “Gee, what does the marketing director think about this particular campaign?” but  “How are our consumers already talking about these products at market?” That will be driving a lot of our answers and responses to even our competitors. I think the fact is that it’s not going to be N-equal-one decision-making anymore. It’s going to be a lot more N-equal-10,000 pieces of data that’s going to help us make these choices.

Leonard Murphy:  Steve, what’s your take on that?

Steve Rappaport: Well, I agree with Andrew, I mean, and Charlie. Geeks will rule. I read something not too long ago about the kinds of people who are really scoring big when they leave college, and they are the really heavy-duty computer scientists, data analysts. They’re really becoming sort of the rock stars of companies today, but the part – what I could add to this discussion is that having the ability – like Andrew and Charlie pointed out – having the ability to bring in these streams to data, to analyze them and all of that, having all of that is extremely important, and there’s another aspect that’s very, very important too, and that is the ability to ask the right questions of that data, so that when all of the analysis is done, that the understanding that results is really going to help the business and drive it forward, because without really good, penetrating business-critical questions, it’s possible to run the risk of just analyzing and analyzing and analyzing data without really having it have an impact.

Andrew Jeavons:  I have something to add. I think that’s absolutely true, and that there is a lack of theory of, first of all, why people answer questions. I said to somebody yesterday – it was a government conference. We have no respondents’ theory. We have no theory of why people will actually answer these questions or take part, and that seems to be pretty critical. I also come from a background in neuropsychology and cognitive psychology, and there’s this lack of theory where I’m always thinking, “Why did somebody pick up the phone and answer and sit through these questions?” There’s no theories about this.

Steve Rappaport: I agree. I’m really glad we’re meeting this way, because, I’d just say I second that wholeheartedly, because it’s the absence of theories and frameworks in our business, it’s really harmful.

Andrew Jeavons: And, well, yes, and we should talk sometime. We’d have a great time.

Steve Rappaport: Sorry for everybody on the phone.

Andrew Jeavons: I’m in Cincinnati with Charlie, and he stole my iPad the other day, so –

Leonard Murphy:  He brings up a good point.

Charlie Rader: Actually, I’d like to chime in too on this one – that when I get asked internally about all these new types of market research tools that are at our disposal, and what do we want to pilot next? What do we want to learn from next? Inevitably, the question comes up is, well, what about the data validation? And my answer is very simple. It says, we will always do research among people who do research with us, and so to say that we have a rep population, or we’re getting a particular target, and people are saying, “Well, it doesn’t skew this way or that way or the other,” and it’s like, well, of course there are data skews depending on the channel that you’re looking at, but the fact is that we’re always skewed with the fact of, there’s a group of people that will answer surveys, that will talk to us in this way, and who also say very forthcomingly, social media isn’t necessarily the answer to that.

Certainly, people will talk about these things freely, but I also think that social media is an aspirational type of being. I mean, when I post stuff on social media, I want to look smart and cool, whether I’m spurring something on that I like or I’m bashing something I don’t, so the listening aspect to it, I don’t think social media will solve all of our research respondents’ validation question, but I think that this lack of theory of why people answer is something that really could stand to be understood better.

Leonard Murphy:  I think – and this is fascinating, and an important part of the conversation. We might have a whole other webinar on this particular topic.

Charlie Rader: I digress.

Leonard Murphy:  No, no, there is no digression. This is appropriate. Part of this whole idea of divergence is that we are getting to – we’re becoming part of the fabric of consumers’ lives, rather than being intrusive. A lot of this is quasi-ethnographic, observational, passive data collection and listening. I mean, we’re becoming voyeurs to an extent, data voyeurs in consumers’ lives, and the ultimate goal of that is to try and use that information to help make their lives better, while also making money while we’re doing it, right?

Charlie Rader: Agreed.

Leonard Murphy:  That’s the end goal, so that is a very different framework than we have had in the past, so we have accessed information, and it’s certainly unprecedented, the lack of frameworks.  I think so because we’ve never been able to do this before. Once again, technology overtook experience, so we’re in that phase now where, by experimentation and going forward with these, engaging in these ways, we’ll develop those frameworks, and we’ll go from there, and you know what? It’s funny, at least for me, being kind of a macro observer of the industry, at the same time we saw this massive growth around social media and mobile and these more technology-driven approaches, the same time, we saw a massive explosion in focus on behavioral economics, emotional measurements, and I don’t think that’s a coincidence. Now, the data aspect of things has become less of a driver of the value of the research. We’ve seen a massive shift towards a focus on trying to understand humans, and why we do what we do, think the way we think, buy the way we buy.

Andrew Jeavons: Heaven forbid we’d have psychology in market research. Dear.

Leonard Murphy:  I’ve predicted for quite some time that the future market researchers will be psychologists, anthropologists, sociologists, and data scientists, but not the – not kind of the traditional operationally-focused people that we have predominantly in the industry today, but what do you guys think about – are we entering into the possibility of a golden age now, since we’re so close to the consumers and the SoLoMo and the tsunami of data available to us is forcing us to reexamine ideas at a very basic level, of simply how we pick as humans, and why we do what we do? Are we looking at a future that’s the ultimate convergence of psychology, cognitive science, and data science? What do you think? Anybody, jump in, or I’ll pick on you.

Charlie Rader: I would say that in the short term, we’re not quite at that convergence yet. These are still fairly siloed data streams. I think while we’re looking at big data in certain ways, whether it’s social or mobile-type data, or massive data collection, you turn on your iPhone and you get GPS data for a week on a particular person or group of folks. I think the aspects of handling the ethnographic, handling the truly behavioral psychology, facial expression, neutrometric, some of those things, which can be very rich, are very singular, very qualitative in nature and not big data in nature. While certainly eye tracking measurements generate beaucoup amount of data points, it’s ultimately an N-equal-one data point.  How is this person responding? It’s the question of are we going to get to the true psychology in all these things? I’m a little bit hesitant in the short term, I would say the two, three year mark, but all these particular types of research methods get us truly closer to understanding behavior and not just a demographic.

Andrew Jeavons: Then again kind of as the token psychologist, this true understanding of behavior – they’ve never managed before.  I think one of the things that has interested me most is the sudden growth of interest in behavioral economics and Kahneman and all this stuff, and I won’t go on my Kahneman rant. I was reading Kahneman when I was 20.  It’s very interesting that this has suddenly come up, and he has some of the best theories about how people just behave in a normal mode in the mall where they are sort of that automatic process of purchasing. I think because of the sort of data we’re going to get, the market research, or whatever it becomes termed, has to build those behavioral models and has to use – everybody’s mentioned, Charlie’s mentioned – all these different streams. I think the fusion of all those streams is a tremendous intellectual problem, and I’m really excited to see who starts coming up with solutions.

Steve Rappaport: Being serious now, there’s a lot – there’s really a lot in what Andrew and Charlie said. Personally, I think that this is one of the most exciting times, because there really is such an interest in understanding people as people and not just consumers and customers.  I think all of that is great, and it’s a wonderful thing that we can really sort of understand one another as human beings with motivations and interest and goals and desires and all of that.

I just want to challenge you, Lenny, on one thing. It’s just the phrase of “for the first time” or “just now” or something like that, and I’m kind of cluing to Andrew a little bit. See, I think that there’s a lot that we know about human nature, and even behavior, that we’re just not familiar with, because as, Lenny, as you pointed out, the reemergence of the social sciences is extremely important, and things that especially this is where there’s a big opportunity, I think. There’s tons of knowledge that’s locked up in the anthropology literature about society and social change, what occurs when new technologies and new groups come into a culture, and that, but that, for whatever reason, has really not been that accessible to us. It hasn’t been as popularized and things, but there’s probably a lot that we can learn just by mining a lot of the work that was done in the past, so I just want to sort of get that said about, we have this new opportunity now.

But where I can contribute to the conversation on this topic is that there’s a gap, and the gap that I see is a gap between understanding people better and more fully and more completely, but it’s not being matched necessarily by marketers shifting their understanding of people in line with that, so what I’m trying to say is that although it’s an irony, I guess, in that as we’re understanding more about people, we’re still holding onto our old mental models about how advertising works, how business works, what drives people and so forth, and the progress that we’re making in terms of understanding people will not really be fully realized unless we marketers and advertisers also change the way that we conceptualize people and are willing to change our mental models and the way that we do our business.

Leonard Murphy:  Fantastic point, Steve, and I accept your challenge, and you’re right, so there, but I think your last point about – the ship has to curve within our organizations – I think it’s absolutely spot-on, and it circles back around to the idea we were talking about, norms and metrics, earlier, that – somebody has mentioned Nielsen BASES, and I love Nielsen, and anybody from Nielsen, don’t take this the wrong way, but it’ll be a Herculean task for advertising agencies to move off of Nielsen rating systems. It’s so ingrained into the entire ecosystem of that business. It’s just going to be tough. Same thing is we look at the focus on ad impressions. I always think about last year at ARF when George Foley from Coke said he didn’t care about impressions anymore, he wants to know about expressions. He wants to know if people were talking about his brand. Were they relating to the brand? So I think we’re really in this difficult transition period, where there’s business models across entire industries and organizations are entrenched around very specific metric models that are being challenged, but detangling, decoupling from those type of things is just going to be tough.

Steve Rappaport: Well, I’ve got lots of thoughts about that.

Leonard Murphy:  You go for it, Steve.

Steve Rappaport: No, you strapped me onto one of my hobby horses. Because the short answer to your question is, it takes guts. If you’re really going to change the system, it’s going to take guts, because what happens is – and I usually don’t talk about myself very much, but I was on a panel, actually in Brazil, and I was sitting next to the CEO of one of the major advertising companies and agency networks, and at one point, I just blurted out, I said, “When are we going to stop making the world safe for media planners and buyers?” Because – I’ll explain that one – because the rigidity of these systems is largely tied to the economic models underlying them, but what’s happened is the way that technology has developed, and the way that people are using technology, is that those models really don’t apply as broadly as they once did, and so they need to be changed, but people are really unwilling to change them because all of their buying and selling is based around it, for example.

But more fundamentally, the problem that there is with things like impressions and reach and GRPs, which I spent parts of my career calculating, by the way, is that they’re based on a model of advertising that is less and less relevant, and that’s the model of education and persuasion, because in the strictly analog era, broadcast and mass media.  It was all about getting that message out, impressions, tonnage, how many people did you reach, things like that, but because the model at the time was, you have to make people aware, you have to interest them, you have topersuade them and get them to act – but what we’re saying day in and day out is that those kinds of linear models are holding less and less, explaining less and less, and they’re being replaced by models where you don’t – at the very core, many people don’t need advertising to learn about a new product, for example, yet the whole system’s based on that, so  it’s a very complex question. I mean, it’s a very complex situation, and companies are really holding onto their ways of doing business to protect their businesses, but in fact, that’s what’s preventing progress, and so that’s why I say it really takes guts. It’s going to take someone to stand up there and say, “We’re going to do it a different way.”

Leonard Murphy:  Good stuff, Steve. We do have to start wrapping up, but I’ll tell you what, from that, this conversation alone, I have 10 more ideas for future webinars, so we’ll definitely want to invite you back to explore some of this more. Charlie and Andrew, what are your thoughts on that? Because I think just to kind of bring everything back around full circle – Steve was talking about it, is – SoLoMo is simply the new channels for engagement and for advertising, and so I was thinking about that from a research and marketing standpoint. We are – it all really does come around to this idea of it’s a new world. We touch consumers in various and sundry ways throughout the point of their lives, both deliver message and gain insight, and yet we’re fighting to get – fighting, but there’s certainly a tension between the existing modes of doing things and the unstoppable forward march of technological progress, so what does that mean for your businesses?  Steve and I have the macro view, but Charlie, what does that mean for a company like P&G? And then Andrew, what does that mean for a research provider?

Charlie Rader: I don’t know if I have something new to add here in that what SoLoMo is doing is that there is new channels of engagement, new channels of ways to learn from our consumers, consumers that we’ve never seen before, never talked to before, but there’s definitely fundamental changes that – and ways of thinking that us as P&G – we’ll be struggling with in the short term because we’ve had hundreds of years, and if you think about the official design of the focus group is 50 years plus of how we do learning from our consumer – I think they’re changing on a much more rapid scale than ever before. I think the scale from the VCR to the DVD to the Blu-Ray player, from focus group to online to mobile is that kind of rapid change occurring, so we’re definitely in the midst of that, and we’ve been challenged to do that to make our business grow, so I’m sorry if there’s not new insight there, but just – it is a wrap.

Leonard Murphy:  Good wrap statement, kind of brings it all back together, and so Andrew, the researchers’ perspective?

Andrew Jeavons: I’d just make a quick comment that the biggest changes or the biggest differences in the way people approach surveys and research is coming from some of our clients, who – one of them’s Zynga, who are in games. Now, that whole gaming genre is very new, and they do things very differently, and it’s really interesting to observe, and, in a way, break all sorts of rules, but it works out for them, and we get  development requests that we would never get from traditional survey consumers or market research departments, and I think what we are finding is that while the survey thing is still vitally important, we’re seeing all sorts of different wrinkles, like people turning their loyalty panels into consumer panels. I quoted somebody from 9 million-person loyalty panel. It’s kind of interesting that people are doing things on a huge scale, and they’re breaking down barriers, so it’s all changing.

Leonard Murphy:  It is the top of the hour, and I need to be respectful of everybody’s time, I don’t see any questions on Twitter, but lots of comments. I would say this is maybe one of the best webinars that I’ve been on recently.

Steve Rappaport: Lenny, I want to thank you for inviting me and getting to meet and have a conversation with everybody, because it’s fantastic. I really enjoyed it.

Leonard Murphy: Thank you, Steve. We will definitely do it again, and Charlie and Andrew, you guys both know you’re on the hook for a future opportunity. One plug real quick before we sign off, and it was kind of thrown out there, the market research and mobile world conference we have coming up in Amsterdam in just three weeks. We’ll be talking about a lot of these topics at that conference, and then our July event here in the United States in Cincinnati.  I can say more than hopefully, there’ll be some other folks from P&G that will join us in that event in Cincinnati as well, so we’ll continue to partner in work and explore some of these ideas and how they impact our businesses. On behalf of Research Access and GreenBook, thank you very much, everybody, for your time and energy. There will be transcripts of this available shortly, as well as some blog posts, and hopefully audio recordings. Dana, thank you very much for serving as a host in the background. Everybody, have a great day.

Click here to access the webinar video and slides.

Editor’s Note:  A special “thank you” goes out to Focus Forward for transcribing the webinar.

10 Use Cases for Geolocation in Market Research

GeolocationThe 2012 Where Conference on location and mobile technology is now over, but it made an impression on all who were involved.

Where else would I (and Research Access readers who watched the live stream on April 3 and 4) have seen presentations from people as diverse as these:  Jer Thorp, Data Artist in Residence at the New York Times; Will Wright, the creator of SimCity and proprietor of the Stupid Fun Club; and Josh Williams of Facebook (via the Gowalla acquisition).

It was so interesting for me from a market researcher’s perspective to see not only what’s on the cutting edge in a very cool area of technology, but to see the passion with which those involved in the world of geolocation approach their craft.  You can look forward to more of this type of interdisciplinary cross-pollination from Research Access because not only is it fun and interesting, but hopefully in some small way it provides ideas to help our industry evolve.

Not sure about geolocation and market research? Let me throw out some ideas for how it can and/or could be used (please assume all of these are with the respondent’s consent).

  1. A government agency studies commute patterns in a city by collecting geolocation pings from a sample of drivers.
  2. A city tourism board works with an access panel to ping panelists who live out of town when they show up within a defined radius of the target city.
  3. A consumer products company wants to understand how frequently a sample of shoppers visits different grocery chains and collects geolocation data instead of self-reported behavior.
  4. A small chain of restaurants recruits customers for a panel in-house using QR codes and notifies them about a new menu item taste test when they arrive near a restaurant location.
  5. An automotive company collects geolocation data from a sample of minivan-driving moms to better understand how the product is used.
  6. A bank collects geolocation data from a sample of customers in order to make decisions about where to locate ATMs and branches.
  7. A movie studio captures data on whether respondents who viewed their test movie trailer actually go and see the movie in a theater.
  8. A coffee shop chain works with an access panel to ping people who enter their shop with a special invitation to become a part of a sub-panel of that chain’s customers.
  9. A trucking company can send their drivers a survey (to be completed at a rest stop, of course!) every 10,000 miles driven.
  10. A respondent sets preferences that they only can be sent surveys when they are at home, never when they are at work, on vacation, etc.

I hope these use cases get you thinking about how geolocation can help make your market research better.

Please add your ideas in the comments section below.

A French Revolution in Market Research

Liberty Leading the People - Eugene DelacroixLast year, I was honored to be invited to join a fascinating and exciting market research group on LinkedIn:  Recreation.  That’s re-creation, as in creating again.

The group was formed by a collective of French market research professionals who were dissatisfied with the status quo in the French market research community.  From that group a new market research event was born, Le Printemps des Etudes, which kicks off tomorrow, April 5th in Paris (unfortunately, I won’t be able to attend!).

This week I dusted off my old French textbooks and conducted an interview with the Commissioner General of le Printemps des Etudes, Stéphanie Constant Perrin, who is also the owner of Empresarial, a communications agency which is helping organize the event.

Here is my best attempt at translation of the interview.  The full French version appears below the English translation.

Dana Stanley: Thank you for participating in this interview.

Stéphanie Constant Perrin: With pleasure!

Dana Stanley: The Printemps des Etudes is a new event for the Communication, Marketing and Opinion industry. Why is it important to have a new event?

Stéphanie Constant Perrin

Stéphanie Constant Perrin

Stéphanie Constant Perrin: The Printemps des Etudes is above all a collaborative venture, particularly stimulating, which began in November 2010 at the initiative of the Re-Création group – 350 members, businesses and professional organizations anxious to create an annual event which is representative both of the diversity of the profession and of its dynamism.

Empresarial, holding the call for proposals in September 2011, has deliberately chosen a format with short and rich content, intended to create for all industry players a place, a community and lines of inquiry to better understand their function and environment.

With the Printemps des Etudes, the Communication, Marketing and Opinion sectors have the necessary tool to bring together all industry players – Institutes, Suppliers, Institutional – around a single event, and to propose offers, solutions and market innovations. The sector is represented in all its richness and diversity!

Dana Stanley: What are the strengths of this new event?

Stéphanie Constant Perrin: The key positioning for the Printemps des Etudes is, first, better quality conference content, which is central to attract a target of marketing and communication decisionmakers; secondly, allowing visitors and exhibitors to develop mutually beneficial relationships; and finally, the representativeness of the industry.

The massive involvement of research and survey companies was a fundamental part of reconnecting with the profession that sees itself as a strategic consulting and decision support. For its first edition, the Printemps des Etudes has succeeded in uniting and bringing together a vast majority of research companies, some of which were absent for several years in any professional event. Also, among the 111 players listed, 57 are institutes and 2/3 are owned by the top 15 in France.

Beyond the companies, the Printemps des Etudes has 35 provider companies and the sponsorship of 5 professional organizations representative of the industry:  ESOMAR, IREP COMMUNICATION ETUDES RECHERCHE PROSPECTIVE, ADETEM, UDA, SYNTEC ETUDES MARKETING & OPINION, and the presence of 12 TPEs (très petites enterprises – very small enterprises) at the center of the assembly.

In reuniting companies, providers and associations, the Printemps des Etudes is a unifying event.

Dana Stanley: What role did the Re-Création group play?

Stéphanie Constant Perrin: The Re-Création group was truly an engine and an actor in the creation of this new event. The Printemps des Etudes is the brainchild of a few professionals who gathered in an online community via the social network LinkedIn, which now reaches nearly 350 members.

After establishing a diagnosis of the market expectations, based on several focus groups, this group has increased its involvement in the creation of the Printemps des Etudes, validating the relevance of the topics covered in the various appointments, a testament to their quality. The quality and quantity of contacts pre-registered for the event is proof!

Dana Stanley: What can one find at the Printemps des Etudes that can’t be found at other industry events?

Stéphanie Constant Perrin: It is important to remember that these are Professional Meetings in Communication, Marketing and Opinion – hence the title – and not just another typical trade show. That is to say that there is at the Printemps des Etudes a true reflection between the exposure portion (66 companies) and the intellectual content (8 lectures, workshops and round tables and 43 appointments), to better target Marketing, Communication and Opinion decisionmakers.  A complementarity of meeting formats for an event centered on business contact.

Similarly, the stands are sold to exhibitors as a turnkey solution, leaving them ample time to focus the preparation for the event and meeting with visitors rather than on logistics, thus promoting the return on investment and quality content.

Dana Stanley: Can people still register for the event? If so, how?

Stéphanie Constant Perrin: Of course!  I invite you not only register, but also to spread the word about the event as widely as possible!

To do this, nothing could be simpler, simply log onto our website www.printemps-etudes.com (“visiter” section / “demande de badge”). You can then access the full program of 7 keynotes and 43 meetings.

However, don’t wait any longer to register, because some of the events are already full!

Dana Stanley: Can we expect any major announcements at the event?

Stéphanie Constant Perrin: There’s only one way to find out – attend the event!  But I can already tell you that in addition to the meetings, the first edition of the Printemps des Etudes will be a chance to discover 69 innovations in the sector.

It will also be an opportunity to witness the birth of a new institute, “l’institut Adequation MR,” and the anniversary of several others: 2 years of Smart Store (June 2012), 5 years of Scènes de Vie (May 2012), 10 years of l’Institut des Mamans (Aprill 2012), 10 years of Netquest (2012), 12 years of Rosae (April 2012) et 35 years of Socio Logiciels (2012). Among others…

And here is the original interview in French…

Dana Stanley: Merci de votre participation à cette interview.

Stéphanie Constant Perrin: Avec plaisir!

Dana Stanley: Le Printemps des Etudes est le nouveau rendez-vous de la filière Communication, Marketing et Opinion. Pourquoi était-ce important d’avoir un nouvel événement?

Stéphanie Constant Perrin: Le Printemps des Etudes est avant tout une aventure collaborative, particulièrement stimulante, qui a commencé en novembre 2010 à l’initiative du collectif Re-Création – 350 membres, entreprises et organisations professionnelles – soucieux de réinventer un rendez-vous annuel à la fois représentatif de la diversité de la profession et de son dynamisme.

EMPRESARIAL, retenue à l’appel à projet en septembre 2011, a choisi de mettre en place ces Rencontres Professionnelles, dans un format volontairement court et riche de contenus, et de proposer à l’ensemble des acteurs de la filière un lieu, une communauté et des pistes de réflexion pour mieux appréhender leur fonction et leur environnement.

Avec le Printemps des Etudes, la filière Communication, Marketing et Opinion a trouvé l’outil qu’il lui fallait pour réunir l’ensemble des acteurs de la filière – Instituts, Prestataires, Institutionnels – autour d’un seul événement, et pour proposer les offres, les solutions et les innovations du marché. La filière est désormais représentée dans toute sa richesse et sa diversité!

Dana Stanley: Quels sont les points forts de cette nouvelle manifestation?

Stéphanie Constant Perrin: Les axes de positionnement retenus pour le Printemps des Etudes sont tout d’abord un renforcement de la qualité des contenus des conférences, qui sont centraux pour attirer une cible de décideurs marketing, communication et études. Ensuite une dimension commerciale importante pour permettre aux visiteurs et aux exposants de développer des relations mutuellement profitables, et enfin, la représentativité de la filière.

L’implication massive des instituts d’études et de sondages était fondamentale pour renouer avec la profession qui assume son rôle de conseil stratégique et d’aide à la décision. Pour sa 1ère édition, le Printemps des Etudes a réussi son pari en fédérant et réunissant une très grande majorité d’Instituts d’Etudes, dont certains étaient absents depuis plusieurs années de toute manifestation professionnelle. Aussi, parmi les 111 acteurs inscrits, 57 sont des instituts et les 2/3 appartiennent au 15 premiers de France.

Au-delà des instituts, le Printemps des Etudes c’est aussi 35 sociétés prestataires, le parrainage des 5 organisations professionnelles.représentatives de la filière : ESOMAR, IREP COMMUNICATION ETUDES RECHERCHE PROSPECTIVE, ADETEM, UDA, SYNTEC ETUDES MARKETING & OPINION, et la présence de 12 TPE (très petites entreprises) au sein d’une agora.

Aussi en réunissant Instituts, Prestataires et Institutionnels, le Printemps des Etudes a donc tout d’une manifestation fédératrice.

Dana Stanley: Quel rôle a joué le collectif Re-Création?

Stéphanie Constant Perrin: Le collectif Re-Création a véritablement était moteur et acteur dans la création de ce nouvel événement. Le Printemps des Etudes est né de l’imagination de quelques professionnels qui se sont rassemblés dans un collectif online via le réseau social LinkedIn qui atteint aujourd’hui près de 350 membres.

Après avoir établi un diagnostic sur les attentes du marché, reposant sur plusieurs groupes de réflexion, ce collectif a renforcé son implication dans la création du Printemps des Etudes en validant la pertinence des sujets traités lors des différents rendez-vous, gage de leur qualité. La qualité des contacts préinscrits et leur quantité en est la preuve!

Dana Stanley: Que va-t-on trouver au Printemps des Etudes que l’on ne trouve pas sur d’autres événements de la filière?

Stéphanie Constant Perrin: Il est important de rappeler ici qu’il s’agit de Rencontres Professionnelles Communication, Marketing, Opinion – d’où son titre – et non d’un énième salon professionnel classique. C’est-à-dire qu’il existe au Printemps des Etudes une vraie réflexion entre la partie exposition (66 sociétés) et le contenu intellectuel (8 conférences, ateliers et tables-rondes et 43 rendez-vous), pour cibler au mieux les décideurs et responsables Etudes, Marketing et Communication.

Une complémentarité de formats de rencontres pour un événement centré sur le contact d’affaires!

De même, les stands sont vendus clés en main aux exposants, ce qui leur laisse tout le loisir d’axer la préparation de l’événement sur la rencontre avec les visiteurs plutôt que sur la logistique, favorisant ainsi le retour sur investissement et la qualité des contenus.

Dana Stanley: Peut-on encore s’inscrire à la manifestation ? Si oui, comment?

Stéphanie Constant Perrin: Bien évidemment ! Je vous invite non seulement à vous y inscrire, mais aussi à relayer cet événement le plus largement possible autour de vous!

Pour cela, rien de plus simple, il suffit de vous connecter sur notre site internet www.printemps-etudes.com (rubrique visiter/demande de badge). Vous pourrez ainsi accéder au programme complet des 7 Grandes Conférences et celui des 43 rendez-vous.

Toutefois, victimes de leurs succès certains rendez-vous et conférences affichent déjà complets. Ne tardez donc plus à vous inscrire ! »

Dana Stanley: Peut-on attendre des annonces fortes lors de la manifestation?

Stéphanie Constant Perrin: Il n’existe pour cela qu’une seule façon de le savoir : venez nous rendre visite ! Mais nous pouvons d’ores et déjà vous révéler qu’outre les conférences et rendez-vous, la 1ère édition du Printemps des Etudes sera l’occasion de découvrir 69 innovations du secteur.

L’occasion aussi d’assister à la naissance d’un nouvel institut, l’institut Adequation MR, et l’anniversaire de plusieurs autres : les 2 ans de Smart Store (Juin 2012), les 5 ans de Scènes de vie (Mai 2012), les 10 ans de l’Institut des Mamans (Avril 2012), les 10 ans de Netquest – (2012), les12 ans de Rosae (Avril 2012) et les 35 ans de Socio Logiciels (2012). Entre autres…

Buzzword Alert: What the Heck is SoLoMo?

SoLoMoThere’s a new buzzword blazing into town, and it seems to be causing some divisive feelings.  The term is “SoLoMo,” which is a combination of the words “social,” “local” and “mobile.”

SoLoMo represents a concept which is a tidal wave in our evolving society:  the convergence of social, local and mobile technology.  Our lives are changing dramatically as technology becomes more mobile, empowers deeper social connections and becomes localized.

In the most recent episode of the Research Life Podcast, “Market Research Buzzwords and the Hype Curve,” Affinnova’s Jeffrey Henning gave a good example of SoLoMo: he recently had an unplanned meeting with a friend in an airport enabled by social connections on his mobile phone.

Of course, as society goes, so goes market research (well, eventually).  We are seeing dramatic examples of technology enabling things heretofore impossible with a combination of mobile technology, geolocation and social media.

For example, technologies such as SurveySwipe and MicroPanel make it possible for panelists to receive a survey notification on their smartphone when they are close to a particular location such as a retail establishment.

SoLoMo represents an important concept, but as buzzwords go it’s definitely getting under some people’s skin.

Anthony Ha crystallized the anti-SoLoMo point of view in a great TechCrunch post on Saturday, “You Say ‘SoLoMo,’ I Say ‘I Hate My Life.’”

I happen to like buzzwords, but I get why this particular one is bugging people.  It’s cutesy, and it simplifies a complex issue with an oddly capitalized rhyme.  And people like to go against trends because it makes them feel smart.

Furthermore, SoLoMo sticks in your mind, just like an annoying 80’s song.  Remember Everybody Have Fun Tonight by Wang Chung?  I thought so.

One of the things I like about SoLoMo is that it’s a superbuzzword, because it’s a combination of three other words which themselves are buzzwords.

Kevin Courtney makes a good point about SoLoMo and buzzwords generally in the Irish Times:  “Good mantras often come in three words that lend themselves to easy repetition; like Reduce, Reuse, Recycle, or Location, Location, Location. When you want to remind yourself of what’s important, or stay focused on your core goals, a good mantra is like a compass that keeps you on the right path.”

At the risk of offending any buzzword sensitivities, let me tell you that Research Access and Greenbook have partnered to bring you a webinar on the topic of, you guessed it, SoLoMo in market research.

“SoLoMo: How Social Media, Localization & Mobile are Redefining Marketing Insights,” will be a panel discussion on Thursday, March 29th at 1pm Eastern / 10am Pacific.  The panel includes Charlie Rader, Digital Insights Tools Leader, Procter & Gamble and Steve Rappaport, ARF Knowledge Solutions Director and Author, Listen First! The session will be moderated by Lenny Murphy, Editor of the GreenBook Blog.

I hope to see you then!

Click this link to register for the webinar.

Market Research Buzzwords and the Hype Curve

BuzzwordsIn Episode 2 of the Research Life Podcast, we have two special guests:  Jeffrey Henning, CMO of Affinnova and Andrew Jeavons, President of Survey Analytics.

Andrew, Jeffrey and I discussed a list of buzzwords in market research, and attempted to place each on the Gartner Hype Curve.

Our buzzwords came from a list published by Research Magazine of the top 10 buzzwords on Twitter from 2011 using the #mrx hashtag.

  • Mobile
  • Gamification
  • Analytics
  • Innovation
  • Communities
  • Social Media
  • MROC
  • Co-creation
  • Shopper
  • Behavioural

We added in an additional 4 buzzwords which could be trending in 2012:

  • Passive data collection
  • SoLoMo (social / local / mobile)
  • Network intelligence
  • Big Data

The Gartner Hype Curve

This podcast was a lot of fun.  Have a listen by clicking over to the Research Life Podcast page on iTunes, and be sure to subscribe in order to get future episodes.

Let Jeffrey, Andrew and me know what you think by writing in the comments section below.

Click this link to get the podcast on iTunes.

NOTE: If you cannot access this episode on iTunes, use this link to download the episode directly.

Market Research is Beating Marketing Research

Market Research or Marketing ResearchIn a recent post I posed a question: “Which term do you prefer: market research or marketing research?” In it I gave readers a chance to vote on which term they prefer, or to choose “no preference.”

As of this writing, with 27 votes, “market research” is beating “marketing research” 56% to 30%, with 15% choosing “no preference.”  Full disclosure: I cast my vote for “market research.”

This is all well and good, but I’d like to see some more results before coming to any conclusion.

Please “weigh in” (cue rimshot) on the “market research” vs. “marketing research” MicroPoll, which I’ve re-embedded below, as well as in the comments section at the end of the post.

A Discussion of Text Analytics with Michael Tupanjanin

Michael TupanjaninWhat follows is the next in a series of interviews I conducted at the Net Promoter Conference in San Francisco last month.  If you missed my video interview with Dr. Ming Duong-van, you’re going to want to click over for a listen to his fascinating interview.  Still to come is an interview with Satmetrix CEO Richard Owen.  This interview is with Michael Tupanjanin, the CEO of Metavana.  The interview was conducted in the morning on the day Metavana and Satmetrix announced a partnership to create a social Net Promoter Score called the SparkScore.

Dana Stanley: We’re here at the Net Promoter Conference at San Francisco with Michael Tupanjanin, CEO of Metavana, as well as the company’s CMO, Romi Mahajan.

Michael, why don’t you go ahead and tell people who aren’t familiar with Metavana a little bit about your company.

Michael Tupanjanin: Sure, so Metavana was started about three and a half years ago by a guy named Ming Duong-van.  Dr. Ming is very well known in the academic circles primarily as a physicist. He was actually the co-founder of chaos theory. And he’s spent a lot of time studying the text analytics market and has, I think, done some incredible breakthroughs, scientific breakthroughs, specifically the algorithms that he’s written for Metavana that really take a look at text, specifically in the social web, and really uncover the true meaning and opinions that people have on the social web.

Dana Stanley: So when you’re talking about the social web and text, give me a practical sense of what type of data your software’s analyzing.

Michael Tupanjanin:  Well, I think just about every piece of text as far as I know is unstructured on the social web, which can be incredibly chaotic. So if you think about the correlation of people that have studied chaos theory and the clusters of galaxies, you’re actually able to apply that scientific principle to the social web, where the conversations are unstructured, the sentence and the grammatical structures are completely wacky, and the content itself is very unstructured. Being able to actually get meaning out of the second structures is a very difficult thing to do.

Dana Stanley:  What are some examples of how folks are using the Metavana technology to gain insights?

Michael Tupanjanin: We have a couple customers, like Marriott, they have a customer service group that spends a lot of time looking at the social web analyzing things like the basic things, what was your stay like at our hotel? Were the beds OK? Were the towels OK? Was the room service OK? And they’re always analyzing those pieces of information to see how they could improve their service.

We have another company that’s using our technology for smartphones. So right now, the smartphone market is incredibly competitive. We have a clear leader in iPhone, and they’re trying to figure out what their competitive advantage is. What kind of things can they put into their product to make them better? They’re also looking at customer service issues.

Dana Stanley: What do you say to people who throw out the idea that not all sentiment is on the web, that the people who participate in the web, that’s just a segment of all that sentiment that people need to pay attention to.

Michael Tupanjanin: That’s a good question. I’m a neophyte in market research. But here’s my impression. Market research is actually somewhat limited in terms of the sample size, right? You send out a survey to a bunch of people, but the sample size of the social web’s a lot larger than the sample size that you send out to people through your surveys themselves. And I think there’s also a predisposition amongst people that actually are willing to fill out a survey, as opposed to people that are just expressing their opinions on the web where it’s a little less stilted, and you actually probably get more meaningful information back.

Romi Mahajan: Dana, can I just pop in on that?

Dana Stanley: Absolutely.

Romi Mahajan: I think it’s a very prescient questions about how big, how complete is your set, right? And clearly, the social web is not everything, but there are 845 million people on Facebook. There are 250 million, bordering on now 270 million tweets a day. And each of these expresses something. Now, not all of them express sentiment, but a lot do. I think where normal, canonical market research needs to grow and evolve is in the notion of active data collection versus passive data collection, where what people are expressing on the social web is– they’re expressing it while in the context, their natural context.

They’re not being prompted. And so you get a different set of data, right? You get maybe a more natural set, a more authentic set, but a different set. In reality, when you put these two sets together, you get the truth. But the fact that structured data is easier to come by and unstructured data is harder to decipher, that’s what gives a company like Metavana room to maneuver.

Dana Stanley: Where do you think companies are in terms of their approach to this? Are companies diving into sentiment analysis? Are they wary? How would you assess that?

Michael Tupanjanin: I think that the market, in general, is incredibly interested. And I’ll take it to a higher level called text analytics as opposed to sentiment analysis.

Dana Stanley: Sure.

Michael Tupanjanin: I think the market’s incredibly confused. I think the market’s incredibly chaotic right now. There are lots of solutions that are available in the market. And I think a lot of the solutions are incredibly complex to actually do implementations to. So traditionally, a lot of those sentiment analysis or text analytics seem to reside with the knowledge management people inside major companies. And I think there’s a huge opportunity to actually now take it out to the masses, to the functional leaders, the sales leaders, the marketing leaders, the product management leaders, the research leaders, where they really haven’t had access to this kind of technology before.

I think there’s a lot of latent demand for it, but there’s also a confusion because I think so many different companies are approaching it in so many different ways. And I think traditionally the accuracy levels have not been that great. So I think there’s a little bit of skepticism, too.

Dana Stanley: So help me understand Metavana’s unique approach.

Michael Tupanjanin: So without getting into a long, scientific explanation – what it all comes down to is the algorithms that you write and how accurate they are and the principles that you apply. Traditionally, there’s been two approaches to what we’ll call text analytics. There’s been the natural language processing approach and then the more machine-learning approach.

The natural language processing, tends to be a very highly curated approach, like almost a lot of human intervention actually looking at grammatical structures and trying to develop taxonomies to be able to pull out the meaning, versus the statistical approach, which is much more automated and based specifically on algorithms themselves. Traditionally, people have felt that the statistical approach is less accurate, that the natural languaging process approach is more accurate.

However, the natural languaging approach tends to be not scalable because you have to spend a lot of time going through taxonomies versus having a more statistical approach, which is much more scalable. We tend to be more towards the statistical end, but the algorithms that we have written have taken accuracy to a whole new level, up to over 95%.

Romi Mahajan: Dana, it’s a great question. I think Michael answered it correctly on the scientific side. When we think about our business in general, right, we think about three core principles around why we think we’re unique. One is clearly accuracy, right? So whereas the industry is offering scarcely better than a coin toss accuracy, we’re offering one standard deviation away from perfect, so 95%, 96%. The second is what we call accessibility. We don’t believe that customer satisfaction understanding the social web should be sequestered or siloed someplace in the CSAT division of a company. It’s really for everyone.

So we’re building a system that allows any one in the corporation to be able to take– to interpret the social web. Accessibility is the next thing, true enterprise scale. And the third thing is scalability. We believe that our business model is going to offer the ability for anyone, regardless of price point, regardless of degree to which they believe in the social web or not, to access the social web. So those three principles we think make us unique.

Dana Stanley: That’s great. One thing that stood out, you mentioned the accuracy level. I’m just curious, how do you measure accuracy, or how do you self-evaluate as your algorithms presumably evolve?

Michael Tupanjanin: Yeah, we actually have to do it the old fashioned way. We literally will take– we recently did about 3,000 quotes that we actually rated, and we sat down with a bunch of high school kids and actually had them go through sentence by sentence by sentence and see, how would you score this sentence? And how did the machine score the sentence?

Dana Stanley: So you’re basically giving them homework?

Michael Tupanjanin: Absolutely.  There is no other way to do it because you can either do it some kind of automated way, which again, people question whether or not that’s the right way to do it.

Romi Mahajan: The thing is, once you go through the high school exercise, then the system learns on its own. But you have to go through the initial validation period to make sure that if someone leaves Starbucks and says, man, that Americana was awesome, that somebody’s verifying that that’s a positive comment.

Dana Stanley: Yeah, and how do you account for evolving language, and Urban Dictionary entries, and the fluid nature of language?

Michael Tupanjanin: Yeah, so the way the process is set up, we actually– one of our unique things is that we actually do things on a domain by domain basis. So we, for example, we’ll start with smartphones as a category. We’ll start with printers as a category, hotels, or airlines. And each of those domains has their own specific language in them. And one of the things that we do is the engine goes out actually crawls and trains itself on the language of that particular domain. So that’s one of the reasons that we get such high accuracy rates.

But the reality, as you said, is that language continues to evolve. And new words of slang appear all the time. So we found that we have to at least have the engine retrain itself every quarter. And it’s not a manual process. It’s literally simply going out and crawling the same data sources and doing almost like a QA process on the data sources for about a week, and then it’s updated itself on the slang. What it also does is it updates itself on categories. So what the engine does when it goes out and crawls, versus having a taxonomy that’s kind of predetermined, it actually will develop its own taxonomy based on organically what seems to be the right category.

So, for example, we crawled the airline industry, and lo and behold, the categories that came up were seating, crew, entertainment, waiting lines at the airport, baggage handling, all the things you would suspect. But at some point, there could be other categories that emerge.  For example, security, gate security, and stuff like that seems to be starting to percolate on the social web could become a category, too. So that’s part of the engine’s updating process.

Dana Stanley:  Do you sometimes get into arcane industries where maybe the client would have particular language that your incorporating as you go along?

Michael Tupanjanin: Some industries are more difficult than others. We’ve actually looked at, for example, one of our customers is a coffee machine manufacturer. And that’s a fairly simple, straightforward thing versus pharmaceuticals, where you start to get into some pretty arcane language around drugs and therapies, and that’s a lot more difficult. So I don’t know if we have all the answers for you. We’re looking at– pharmaceuticals, I think, will be a little bit of a tougher industry for us.

Dana Stanley: Interesting. And is it just English at this point?

Michael Tupanjanin: English, yes. We’ve done, now, tests in both Chinese and French. And interestingly enough, it’s taken about a day.

Dana Stanley: Wow.

Michael Tupanjanin: Yeah.

Dana Stanley: It took me longer than that to learn French.

Michael Tupanjanin: Well, what’s interesting about the technology, it’s not based on grammatical structure. It just needs to have a translation of all the words themselves, and then it can go out and train itself. So again, it’s a little bit different approach.

Dana Stanley: Interesting. So I have to ask, we’re here at the Net Promoter Conference, and by the time this interview is out, your release will have hit the wires. So tell me about this exciting initiative that you have going with Satmetrix.

Michael Tupanjanin: Well, from our perspective, it’s amazing on a couple of different levels. First, Satmetrix is clearly the leader in Net Promoter. They wrote the book on it. And they have established a very clear set of activities and workflows for people to actually improve their net Promoter Scores. So they are the methodological geniuses and also the workflow geniuses for helping companies improve their Net Promoter Score. And they’ve tied that directly to revenues, which is also a really, really good thing.

I think, from our perspective, being able to provide people a Net Promoter Score like a stock ticker, real-time, is huge. The old model has been you get your survey results back. You work on them and see how you improve over the next quarter. Now, you have an opportunity to actually see how you’re improving every 10 minutes if you need to, which is a huge breakthrough. And this is not an easy thing to do or replicate. From our perspective as a text analytics company, the fact that we have such high accuracy rates and the fact that our machine is flexible enough to actually take somebody else’s methodology and apply that to the social web is huge. There are very few people who can actually do that.

So from our perspective, it’s great. It also makes the information a lot more actionable. One of the things that I think the industry suffers from is that people sit there and say, yes, this sentence is positive. This is negative. Baggage handling was poor in this airport. What are we going to do? Who’s going to get that information, and what are they going to do with it? Being able to tie that to some kind of a standardized score for a company, I think, is a really big deal.

Romi Mahajan: So Dana, in about 45 minutes from this interview, but of course before this interview is published, there’ll be a piece of press on the wire around what we christened the SparkScore, which is a social NPS gauge. And it’s taking the notion of NPS, which is an industry-proven powerful methodology for loyalty and profit driving and completing the picture. The panorama is now complete. It used to be about structured, episodic, survey-based loyalty. And now it’s about the constant here-and-now social web loyalty. So we believe it’s a huge breakthrough for the industry, and Metavana’s very happy to power the SparkScore with, of course, Satmetrix, being the methodology and software provider.

Dana Stanley: So if I’m a customer who’s accustomed to using a Net Promoter Score, what will change for me?

Romi Mahajan: So I think your world gets better, slightly more complex but better, because we’re not saying don’t do normal Net Promoter. There’s a certain value in getting episodic structured data, longitudinally and otherwise. There’s also a certain value in understanding what’s being said anyway, unprompted, every day, 24/7, 365 worldwide. And so when you munge the two, you actually look at your business 360 degrees, as opposed to just seeing one fraction of not only the expression but also the ways in which customers express how they feel.

Dana Stanley:  That’s great, very exciting. So for the traditional, for lack of a better word, market research community, what should they take from this announcement?

Romi Mahajan: Let me break it into two categories. One’s smaller, and one’s bigger. So if the market research people who are familiar with, espouse, or follow NPS, clearly this is going to be a breakthrough, because it’s taking a very proven, powerful methodology and making it 21st century. It’s NPS 2.0. So for the NPS followers, it’s huge.

For the non-NPS followers, we’re all familiar enough with market research to know that it’s grappling with the abundance of data and the abundance of content and the burgeoning importance of the social web. And this allows them to start getting data and data feeds from the social web to use in anything, predictive analytics, reports, analysis of any sort. And so we believe that market research is an incredibly important part of the organization and of the industry.

But we also believe that it’s extremely limited by the technology. And now, we’re opening new business for them. So it’s about reinventing the industry and reinventing ourselves as market researchers.

Dana Stanley: Great. And if people want to learn more about the SparkScore, what should they do?

There’s a couple different things they can do if they’d like to learn more about the SparkScore. One is they can go to metavana.com. Then for second, go to satmetrix.com. Those are the best places to learn about the SparkScore. We will very shortly we will very shortly have a website called spark-score.com, very shortly, so not yet, in which people can play around with this and enter stuff in, and see what their score is.

Michael Tupanjanin: It’s interesting because it almost becomes, in a way, like the Klout score for companies, right? So we’re actually going to be posting a website that actually lists out, front and center, what people’s SparkScore is.

Dana Stanley: Interesting.

Michael Tupanjanin:  So anybody has access to it, whether it’s the companies themselves, customers, they’ll be able to go in, look at their Spark Score. We’re starting by rolling out five industries right now. But we think it’ll actually be very much like a corporate Klout score.

Romi Mahajan: Dana, under your tutelage, one day we hope that Research Access has an sNPS ticker running across it, so every company can come up and say, how are we doing?

Dana Stanley: So almost like a stock ticker concept?

Michael Tupanjanin: It is absolutely a stock ticker concept.

Dana Stanley: Very cool. Well, Michael, Romi, thank you for your time today.

Michael Tupanjanin: Appreciate it.

Romi Mahajan: Dana, our pleasure.