Survey Conducting

The rules of research are about to change in Spring 2010. The MRS (UK's professional association for researchers) will begin enforcement of a new ban on use of client goods or services as incentives in a research project.

So many corporate communities, especially branded panels, rely heavily on this very technique for survey conducting.

Who can deny the reason behind it? I remember answering a poll in a teen magazine (was that really decades ago?) where I purposefully skewed my answers to highlight my desire to see more of the content that they were providing in that very issue. I thought it would increase my chances of winning the cash prize! But in fact I couldn't have cared less about Menudo.

With DIY research making a stronger push than ever, how does this affect the position of the professional researcher who is already challenged when trying to coach clients about the "right" way of doing things?

Maybe the promise of mobile research where true engagement through 2-way communication occurs will emerge one technique that can gain answers without bribes. But we'll never escape it will we? Time is money, especially when it comes to hard-to-reach populations.

Maybe it's no big deal. Cash always been king when it comes to the incentive that works for everyone. But where does that leave financial research? :)

In my last post, I wondered about device market share and it's affect on our ability to reach the right people for survey conducting.

I focused on the manufacturer / operating system, but another element also has a significant affect on reach. I guess you could call it Mode. We normally talk about mode in terms of whether we're collecting data over the web, over the phone, face-to-face, etc. Mobile is it's own mode, but there are choices within that mode.  

Specifically, the primary mobile mode possibilities for a mobile survey system are text message, mobile web, and applications.

Check out this interview/podcast from a recent interview at a CASRO event. Heidi Dickert has some good points about how a different type of technology is required when looking at mobile surveys. The message? You can't just replicate the same old approach when it comes to mobile research.





Text messages give you ubiquitous reach, but the commonly held experience among those I speak with is that SMS surveys are good only for very, very quick polls. The burden on the respondent is high, and you can only squeeze in 3-4 questions before participation drops off - and if you haven't seen it yourself, believe me, it doesn't just stumble off the curb, it careens off the grand canyon.

Mobile web feels like it should be familiar since CAWI has taken over as the primary mode of choice in so many countries. However, the problem is that the mobile web isn't great yet for the vast majority of users. You still need a lot of patience. Think about a news page that requires 10 seconds to load, but then you spend 5 minutes reading. That's much more palatable when compared to refreshing screen after screen after screen of a mobile web survey. To reinforce this, check out Mobile Marketer's recent article about slow load time is the #1 performance issue on the mobile web.

Off course we believe in Applications (particularly Java where possible, native where needed). With iPhone App store just reaching it's 2 Billionth download in September, and Facebook's install base leaping from 2 million to 10.5 million in two months with the release of targeted Java versions, the path seems pretty clear to us...

As it gets harder for businesses (and researchers!) to reach people, the buzz about the affect of social networking applications is starting to get louder in our ears...

Apparently some people are wondering if the rise of direct forms of customer interaction like voice of the customer programs will make the use of Mystery Shoppers for mobile data collection a thing of the past.

Judi Hess, president of MSPA calls mystery shopping "a means to measure customer service, product knowledge, and sales ability." More important, she says, it offers subjective, targeted feedback that companies just can't get from less structured kinds of feedback, like social networking tools or surveys.

Ok, I can buy that. Read more here (you'll need to sign up for a free account).


Tom Anderson in particular is pushing us to think about the role of Social Networks and what he's calling "next gen marketing research". He recently interviewed representatives from Facebook and LinkedIn. It's just a start, but you can see that the social networks are starting to think about the convergence of these worlds, too.

Click here for the Podcast


All three of them will be a highlight of an upcoming ESOMAR panel session. This will be one you don't want to miss...



These are great articles to get us thinking about engagement, the future of survey conducting and the way we deliver insight from the market... But one of my favourite approaches comes from a seasoned researcher right here in Canada.

More on that next week...

I ran across this article in the most recent MRA Alert! magazine, discussing how Smartphones, and the desire for a richer mobile service experience, are changing how we look at the mobile phone.


MOBILE PHONES ARE SO MUCH MORE THAN JUST A PHONE

From text messaging to GPS to online banking to social networking to web browsing to gaming to online coupons to watching videos to, well, almost anything.

A quote from this same article says it really well:

"...the most dynamic and important technology platform today is mobile technology, and that from a marketing research perspective, it is becoming clear that mobile devices will be the next breakthrough research environment."


MOBILE RESEARCH GETS GOOD REVIEWS

Contacting people through their mobile device to conduct your mobile market research will also ensure a good response rate.

Robert Manchin, managing director of Gallup Europe, has found that respondents embrace mobile interviews. In a recent article, Pragmatism Over Ideology?, in the May 2009 Research World magazine, Manchin says:

"'We have quite a bit of evidence now that it's more personal because you are not losing someone at the first stage of sample selection (recruitment).' And people seem more likely to give up time on their mobile because 'dead time' is easier to find, such as while commuting or during breaks."


Survey conducting via mobile phones is certainly coming into its own. Why not look into mobile survey software for your future marketing research needs?

I want to expand on my recent post about viability for wireless surveys on respondent devices...

People carry their mobile phone with them just about everywhere they go, and they increasingly view their mobile device as more than just a phone. The landscape is ripe for survey conducting anytime, anywhere, so why hasn't mobile market research completely blown up yet? 

If you take the cost of wireless data out of the equation, then the answer largely lies with the vast array of devices on the market.

Compare the infrastructure question to telephone surveys. Every landline phone transmits voice - it's the main purpose of your home phone. You have decisions to make regarding your CATI software, RDD and sampling strategy. And getting people to pick up and stay on the line and talk to you is a problem, but when you place that call, the phone on the other side will work no matter what brand of phone is in use.

Now move to the Internet... On the web, you have respondents choosing to interact with you through Internet Explorer, Firefox, Safari, Opera, and now Chrome. Your email invitation might get filtered out as SPAM, but there's a relatively small number of permutations that your survey software has to deal with when it serves up questions and answers on a computer screen.

Executing on a cellular survey provides a completely unique challenge. The number of devices, operating systems and even capability within a company's product line are staggering. Add to this that some users might only be able or willing to respond to you by SMS, not over the web, and it becomes clear that choice in the mobile marketplace is a problem.

Corporations don't develop with the notion that compatibility with their competitor is good. In the ever-changing world of mobile devices, they just want to get the next handset out, and get it out fast. Things don't always work as you'd expect...



I wish I could link to the source, but hearsay will have to do for now. At a recent wireless summit, a prominent panelist mentioned that when Transformers the Movie came out, they wanted the accompanying wireless app to work on every mobile device. It took 20,000 versions.

So which methodology do you choose if you want to reach respondents?

Do you go with a strategy that takes advantage of the iPhone, which sold 3.8 million phones in the first quarter this year, or do you choose an application that has been customized to excel on a wide variety of devices, or do you go with SMS - something everyone can use, but limits your research options?  It's a tough choice, because your sampling strategy needs to be considered in tandem with your method of data collection.

Will the market eventually show convergence, or will mobility follow the laws of entropy? Only time will tell...  

With the quality of web surveys coming under more scrutiny lately, researchers are wondering just how bad the problem is (or isn't), and if there is a problem inherent with doing web surveys, how to address that with their clients and stakeholders.

Here is another article on a seperate study, where the response rate before a reminder was 17.9% for the Internet group compared to 73.2% for the paper-and-pencil group.

Wow. What are the implications for your market research data?