Mobile Research - How many participants is "enough"?

Tuesday, February 23, 2010 by Sean Conry
A lot of our clients immediately jump to the concept of "reach" when they first begin to think about mobile research and wireless surveys. They worry that only a small percentage of their panel might be willing to take a survey on their phone, and they think that hard-to-reach groups (like teens) are the perfect audience for mobile research. 

Sure, using consumer engagement techniques that make your interactions more personal and portable should make them inherently more relevant, thereby increasing response and reducing churn.

But that's not what's really exciting about cellular surveys. My favourite conversation with clients is the one when the light goes on the realization sets in that mobile research is about so much more than putting traditional online surveys on a small screen.

What's really exciting is the new reality that as researchers we can take advantage of the billions of dollars that device manufacturers pour into R&D. Built-in functions such as taking photos and capturing GPS coordinates are just the beginning - even so, these basic capabilities provide us with some pretty astounding options for gaining insights from targeted mobile groups and communities!

So how many people do I need in my mobile panel? I by no means decry the important science of sampling, but check out this article that explores how big the ideal online research community should be, and hopefully you too will start to become a believer in quality over quantity.



The wild west of mobile devices and the cellphone survey landscape

Thursday, April 30, 2009 by Sean Conry
I want to expand on my recent post about viability for wireless surveys on respondent devices...

People carry their mobile phone with them just about everywhere they go, and they increasingly view their mobile device as more than just a phone. The landscape is ripe for survey conducting anytime, anywhere, so why hasn't mobile market research completely blown up yet? 

If you take the cost of wireless data out of the equation, then the answer largely lies with the vast array of devices on the market.

Compare the infrastructure question to telephone surveys. Every landline phone transmits voice - it's the main purpose of your home phone. You have decisions to make regarding your CATI software, RDD and sampling strategy. And getting people to pick up and stay on the line and talk to you is a problem, but when you place that call, the phone on the other side will work no matter what brand of phone is in use.

Now move to the Internet... On the web, you have respondents choosing to interact with you through Internet Explorer, Firefox, Safari, Opera, and now Chrome. Your email invitation might get filtered out as SPAM, but there's a relatively small number of permutations that your survey software has to deal with when it serves up questions and answers on a computer screen.

Executing on a cellular survey provides a completely unique challenge. The number of devices, operating systems and even capability within a company's product line are staggering. Add to this that some users might only be able or willing to respond to you by SMS, not over the web, and it becomes clear that choice in the mobile marketplace is a problem.

Corporations don't develop with the notion that compatibility with their competitor is good. In the ever-changing world of mobile devices, they just want to get the next handset out, and get it out fast. Things don't always work as you'd expect...

Todays Comic

I wish I could link to the source, but hearsay will have to do for now. At a recent wireless summit, a prominent panelist mentioned that when Transformers the Movie came out, they wanted the accompanying wireless app to work on every mobile device. It took 20,000 versions.

So which methodology do you choose if you want to reach respondents?

Do you go with a strategy that takes advantage of the iPhone, whichApple Stock Price sold 3.8 million phones in the first quarter this year, or do you choose an application that has been customized to excel on a wide variety of devices, or do you go with SMS - something everyone can use, but limits your research options?  It's a tough choice, because your sampling strategy needs to be considered in tandem with your method of data collection.

Will the market eventually show convergence, or will mobility follow the laws of entropy? Only time will tell...  

Cellphone Survey for Mobile Market Research on Respondent Devices - Is it viable?

Tuesday, April 21, 2009 by Sean Conry
A recent post on this blog linked to some interesting stats:
  • Worldwide mobile phone penetration continues to climb at a break-neck pace, with 4.1 billion mobile subscribers at last count (that's a global penetration rate of 61.1 percent).
  • 1.27 billion fixed line subscribers (18.9 percent global penetration)
In areas like North America where traditional telephone research is a hefty percentage of the data collection that gets done, researchers might have a heart attack for the implications on their sampling plans! It's tempting to think that maybe moving to cellphone survey are just around the corner to relieve our response rate woes! 

Being at a company that specializes in wireless surveys, we're in a very exciting time. But I also have to have a dose of realism - Not all phones are created equal. 

In this story about Smartphone viruses, I learned that Smartphones currently make up about five per cent of the total mobile market, and the most popular smartphone operating system, Symbian, has 64.3 per cent of the smartphone market (3.2 per cent of the entire mobile market).

The line between smartphones and feature phones is blurring with the entry of WebOs, Android and the like. But have you ever browsed the mobile web on anything other than a Palm, Windows Mobile, iPhone or Blackberry? It's miserable.  My Samsung SPH-a920 is awesome - I'd recommend it to anyone, as long as you don't brwose the mobile web.

Setting aside connectivity problems for a moment, and just thinking about the hardware people own, wide acceptance of a mobile phone survey via the mobile web is probably further away than we would like to admit. Perhaps survey applications, text msg surveys and IVR will be our best options for doing a cellular survey in the short to mid term.