Survey System

In an IPSOS study using the Techneos mobile platform, hundreds of smartphone owners have been asked to participate in a mobile digital ethnography study, sharing their feelings, photos and other ‘point of experience’ information that will track how the general public interact with the British Monarchy at the Royal Wedding of Prince William and Katherine Middleton.

The study will be used to gather information in real time on people’s perception leading up to, during and after the event.

Rather than coding the social media content that is freely created, the mobile survey, which is optimized for smartphones, asks direct questions about where people are watching the Royal Wedding to their mobile enabled panel.

The survey asks respondents how they feel about the British Monarchy, who they’re watching the Royal Wedding with and to take a photograph with their smartphone of what they can see now.

The information is uploaded in real time using the respondents’ mobile network carrier and their smartphone - whether they use an Android, Apple iOS, RIM or Windows Mobile operating system.

The mobile survey is taken by each respondent multiple times over the course of the day on their smartphone mobile device. Within the app they capture photos, GPS location and answer survey questions that you’d see in a typical ethnography project. The information will provide real time data on people’s thoughts and experiences that is not possible to be captured in real time using other research methods.

“We’re excited to be working to be working with Ipsos Open Thinking Exchange on this once-in-a-generation project,” said Dave King, Techneos CEO. “On Friday many people will be sharing their thoughts on social media through their mobiles. Ipsos went one step further and used our SODA app to gather structured data from people who are in London watching the wedding, at the point of experience, unobtrusively, in real time.”

The results will be published after the project has been completed.

A mobile digital ethnography project of this kind is particularly well suited to the United Kingdom, where smartphone penetration is at 31% (Ipsos Media CT Report Q1, 2011).

Will you be watching this historical event? Where and who with?

We reported on September 30, 2010 that Android was gaining ground on iPhone’s marketshare.

Four months later, Nielson shows us that the three major mobile operating systems (mobile OS’s) are in a three-way-tie (fig. 1). The inevitable battle for leadership can only be good for end customers, where value and features will be more readily compared before committing to a handset and platform.

 
FIG 1: SOURCE: NIELSEN 2010 http://mashable.com/2011/02/01/nielsen-smartphone-marketshare/

For Market Researchers this offers the hope of greater accessibility to the growing volume of people who can no longer be reached by traditional landline telephones.

The % of adults living in wireless-only households in the US in 2010 versus in 2007 (fig. 2) only enforces the need to consider adding mobile to their research toolkit. 



FIG 2: SOURCE: ‘WIRELESS SUBSTITUTION: EARLY RELEASE OF ESTIMATES FROM THE NATIONAL HEALTH INTERVIEW SURVEY’, JANUARY - JUNE 2010 BY STEPHEN J. BLUMBERG, PH.D., AND JULIAN V. LUKE, DIVISION OF HEALTH INTERVIEW STATISTICS, NATIONAL CENTER FOR HEALTH STATISTICS

Nielsen has also offered some interesting information about the change in trends for the segments of the community who are actively taking up smartphones in America. As you can see from the chart below (fig. 3), uptake of smartphones was led by Asians in Q4 2009, then Hispanics purchased more smartphones, until they equalized at 45% of each demographic owning a smartphone last quarter. 

 
FIG 3: SOURCE: ‘Among Mobile Phone Users, Hispanics, Asians are Most-Likely Smartphone Owners in the U.S.’, 1 FEBRUARY 2010, NIELSON.  
 
And if you look at, for example, Internet penetration for Hispanics in the USA (fig. 4) you will see that the growth in internet use is greater than a non-hispanic US audience. They are proving themselves to be early adopters and market-ready for lifestyle technology solutions. 

 


FIG 4: SOURCE: ‘HOW DOES THE U.S. HISPANIC MARKET LOOK IN 2020?’, DR NADIA ASHRATAN, ELECTRONIC RETAILER MAGAZINE, 21 JAN 2010.

You will need to continue to be relevant to this audience and reach them where they are in order to gather information about their behaviour and purchasing expectations that clients will want. But how big is the market?

Dr. Nadia Ashrafian, CEO of Electronic Media Group, said that: “The U.S. Hispanic market ranks as the third largest “Latin American economy” behind Brazil and Mexico. According to U.S. Census data, there are more Hispanics living in the United States (50 million) than the entire population of Canada at 32.5 million. [They] are like a country within a country.

U.S. Hispanic purchasing power will surge to nearly $1 trillion by 2010–nearly three times the overall national rate over the past decade. In most categories, Hispanics spend more money than the general market. The top areas are groceries, telephone services, furniture, clothing, household products, ingestibles or “wellness” products, fitness products, as well as weight-loss products and automobiles.

Hispanic advertising by U.S. companies has grown 30 percent in 2009, compared with 8.6 percent for the general market. By mid-century, 25 percent or one out of every four people in the United States will be Hispanic and will represent 25 percent of the total population.”

So if 45% of Hispanics own a smartphone and you want to reach anywhere from 5-51% of them who are otherwise unreachable, and tap into nearly 5-51% of $1 trillion then you may just want to consider some kind of mobile feedback mechanism.

The same point could be made for Asian and Pacific Islanders, or anyone else who lives in a cell-phone only household. As we see response rates for email opens decline and market penetration for smartphones rising we see opportunities with smartphones in recruitment , engagement and data quality sharply increasing.

We came across this recent article by Robert Wenig, Founder & CTO of Tealeaf Customer Experience Management Solutions and thought you would enjoy reading it as it relates to usability issues that impact PDA surveys, Mobile CAPI and Mobile Panel apps. The link to the TeaLeaf blog is at the end of this blog post.

Perhaps my thinking was backwards.

When I first started thinking mobile, I had it in my head that the functionality of a mobile app would be a subset of the existing desktop-browser experience.

When you start thinking about the:

A.  The itty-bitty twit screen
B.  Lack of keyboard
C.  Limited bandwidth
D.  Limited OS and processor
E.  Limited storage

And then the fragmented eco-system of iPhone, iPad, iPod, Android, Blackberry, Palm, Nokia, Windows Phone with different OS levels and the like — the “subset” mentality was easy to make. Who is going to build native apps — isn’t every device manufacturer just going to try and build a browser that approximated desktop agility?

Perhaps somebody put something in my Coke, but now I’m seeing things differently. Native apps on mobile devices change the game.

Mobile applications will be a superset of Web-based applications. Why/how?

Native mobile apps can use all of the functionality/features of the device:

The new 1.3 version gives researchers access to information such as addresses, database lists or results from other surveys to be pre-populated and assigned to individual participants or interviewers for completion.

Researchers can also keep in contact with respondents through an email-style messaging system, and a data-cleaning option corrects any fieldwork errors at the source, rather than at the end of the project.

See the original post:
Techneos upgrades SODA mobile survey service

Click here, to see the Techneos press release: "Techneos Announces Version 1.3 of SODA®"

In a recent blog post I wondered about who was going to tackle the issue of new multi-faceted datasets that incorporate rich media like photos alongside traditional survey answers. Aside from the sheer overwhelming nature of these datasets, the industry is crying out for non-static dashboards and reports as opposed to the tried and true PowerPoint file & stacks of cross-tabs (this was driven home as a major theme at the recent CASRO technology conference).

At that conference I showed how we used Pivot by Microsoft to dig into quali-quant ethnographic data from a recent diary research pilot project. It’s very cool – I recommend checking it out. Microsoft is releasing a way to integrate Pivot “collections” as they’re calling them into Silverlight Websites! It’s a way to share meaningful data in a cool and informative way like I’ve never seen before. (p.s. a big thanks goes out to Candice at Luminosity for pointing me towards this…)

… And if you like that, check out SeaDragon, the underlying technology. This 6 minute overview from the TED site will blow your mind.

Lastly, it looks like there are some new players in this space in MR. I learned about Cognicient, a UK company that specializes in dynamic dashboards for longitudinal data.

Connect these tools to your survey system, and you may just tackle that data yet!
 

1. Augment traditional survey questionnaires with photos and locations to enrich data and drive new insights
2. Greater mobility means a higher likelihood that respondents will have the ability to take a survey anytime, anywhere
3. Time & location stamps give higher confidence that data was entered where and when it was supposed to/reported to be
4. Real-time data allows for compliance monitoring
5. Eliminate the problem of recall

Scenarios which can benefit significantly from a mobile survey system include:

·         Detailed Category Interaction (diary studies)– EG. Snacking/Eating:

o   Where and when did you eat? Why did you choose what you did? What options were available? How did you feel? Show us what you bought/made?

·         Consumption/Usage that happens anywhere, or where location affects choice:

o   FMCG, or disposable consumer goods

o   Tobacco & Alcohol (typically done in academic or social research settings)

o   Diapers

·         Understanding a day/week/month in the life of a respondent segment:

o   GPS capture for significant insight in to patterns

·         Shopping/Retail:

o   Exercises to create outfits, or understand how segments choose where to buy different articles of clothes

o   Pseudo-mystery shopping (audit retail vendor knowledge or Sales Rep attention to customer)

·         Medical:

o   Physician Drug rep encounters

o   Prescription/consumption and results of regulated products

·         Exploratory & Innovation. Perhaps most valuable for dynamic, important or changing segments:

o   New parents, Brand Mavens, Primary Grocery Shoppers, Baby Boomers

·         Advertising and Media Exposure:

o   Where & when did you see advertising? Show us the ad. How did it affect you?

·         Mobile populations, or users of a product or service that by definition is mobile:

o   Frequent fliers / Airline V.I.P.’s

o   Commuters /Heavy Transit Users

o   Sales/Service Reps

• Apple: since its release, the iPhone has set the bar for smartphone usability; its slightly thinner sibling, the iPod touch, is the definition of a sleek, modern Personal Digital Assistant (PDA); and the forthcoming iPad is one of the most anticipated products of all time. Simply put, Apple has a lot of swagger and momentum in the mobile space. But Apple runs a very closed environment that people either love or hate, and this creates opportunities for other more open platforms to shine. Also, while Apple has done very well in the consumer space, it has made fewer inroads into the enterprise, where RIM and Microsoft thrive.

• Research in Motion (RIM): the BlackBerry is one of the most impressive brands of our time. While RIM is often considered less marketing savvy than Apple, I would suggest that their marketing tactics have been every bit as effective as Apple's -- just different. Despite a barrage of criticism about the sexiness and usability of their products, RIM continues to grow and profit at an astounding rate. I personally questioned the usability of BlackBerry products compared to more elegant competitors like iPhone and Android, but I have come to appreciate them as solid, enterprise-worthy devices, and to see the company as a very savvy player in the mobile space. RIM has developed very deep roots with both wireless carriers and enterprise IT departments, as well as a powerful brand that is almost synonymous with thumb-typing on a mobile phone.

• Nokia: the Nokia/Symbian world is complicated. Having personally handled dozens of Nokia phones, I would summarize that their strength is in their diversity of offerings to multiple levels of the marketplace. This is also their weakness. With countless products, three current operating systems, and a solid-but-aging feel on much of their hardware, it is hard to believe that Nokia still outsells its nearest smartphone competitor at more than a 2-to-1 ratio. But while they are not as strong in North America, Nokia is a major player in Europe and downright dominant in many other regions of the world. It is hard to discount a company that produces over 1 million phones per day (yes, you read that correctly). With the incredible depth of carrier relationships and distribution channels which they have developed, Nokia's challenge now is to fill those channels with products that compete with their ever-growing range of competitors.

• Google: Google has garnered a lot of attention since announcing the open-source (and freely available) Android platform in 2007. By providing a smartphone operating system that is free and extensible, Android has garnered support from dozens of handset manufacturers including major players like Motorola and HTC. In contrast to Apple, Google's greatest strength (and weakness) is its openness. I am personally very impressed with most of the Android devices I have used, and as a consumer I have great optimism that Android will be a force to be reckoned with in mobile technology. But I also recognize that openness can lead to fragmentation, and I've heard a lot of grumbling from developers about the lack of standards on Android devices. As Microsoft learned when it allowed device manufacturers and wireless carriers to customize experiences based on its Windows Mobile platforms, I believe that the many emerging flavours of Android devices will make it difficult for developers to target. That said, I believe that Google's ability to integrate the mobile experience with all of their other web-based services will make it a formidable player in the mobile space, and I believe the fragmentation issue can be overcome as Google and other Android licensees learn to coexist.

• Windows Mobile: I recently spoke about the forthcoming Windows 7 Phone Series, so I won't repeat myself on the details. Suffice to say that I think Microsoft has re-entered the mobile race, and demonstrated that they are not planning to turn away from this increasingly important battlefield. Microsoft has learned a lot of lessons over more than a decade in mobile computing, and I believe their enterprise roots will serve them well as they re-assert themselves with a brand new mobile platform. What remains to be seen is whether Microsoft can garner enough consumer interest to unseat competitors in the mass market, or whether it will continue to play a more niche role as an enterprise solution.

• Mobile web browsers are improving in capability and usability, and are finally emerging as a lowest-common-denominator approach to mobile engagement. If you need to reach a lot of people in a relatively shallow way, e.g. to conduct a brief mobile survey about a product or experience, then a mobile browser may well be the way to go. Although mobile browsers are still fragmented, the emergence of mobile web technologies such as HTML 5, JavaScript, CSS and Adobe Flash are making it more viable to reach a wide mobile audience.

• Downloadable applications provide a richer user experience for applications such as diary studies and mobile panels, but they are typically harder to deploy to a broad range of users. Also dovetailing with Sean's recent post about quality over quantity, I would argue that in many cases a more select audience that is highly engaged is more valuable than a broad audience that is minimally engaged. It is these cases -- for example digital ethnography with alarms to trigger highly contextual questions at random times -- where mobile apps really shine.

• Sliding scale questions
• Photo capture on Palm OS, Windows and Windows Mobile
• Encrypted and compressed data transfer
• SPSS v13+ export
• Improved user-selectable missing
• Ability to launch external Windows Mobile applications
• Improved CSS formatting on Entryware Mobile for Windows
• Improved string handling in scripting
• Additional African language support
• Support for Palm Pre devices
• 5-way navigation
• Improved searching capabilities in Data View Report
• Project automation to auto-start questionnaires
• Improved graphics quality including hi-res Windows Mobile screens
• Diary survey engine for Windows Mobile
• Printing capability for Bluetooth printers
• Ability to convert Multiple Response questions to a series of Single Response questions
• Various other small enhancements

• Worldwide mobile phone penetration continues to climb at a break-neck pace, with 4.1 billion mobile subscribers at last count (that's a global penetration rate of 61.1 percent).
• 1.27 billion fixed line subscribers (18.9 percent global penetration)

In January, Palm took the world by storm by announcing both its new webOS and the Pre smartphone, which have been touted by many as setting a new bar for mobile phone functionality. Planned for release sometime this quarter, the Pre has leapfrogged Palm from a once-prized but aging provider of PDAs and smartphones, to an innovative leader with the coolest mobile device to hit the market since the iPhone. With a new team of superstars at the helm (many of whom came from Apple), Palm's recent announcements have impressed techies and investors alike.

But the question we have all been asking for the past couple of months is... what is the future of Palm OS applications like Entryware?

Today we heard the news we've been waiting for... that Palm OS applications will be supported on Pre devices. We had reason to believe that some form of Palm OS support would be available on webOS devices, but we've been in a bit of a holding pattern awaiting confirmation.

Palm devices have always been ideal for survey research, because Palm OS offers a simple, elegant interface that is consistent and easy to use.  Although Entryware software also runs very well on Windows devices, as long-time Palm fans we are thrilled to see that a whole new generation of Palm devices will continue to be turned into best-of-breed wireless survey systems.

Techneos is committed to ensuring customers a smooth transition from existing Palm devices to the next generation of webOS phones. In the meantime, existing Palm devices like the Centro, Treo and TX -- all of which are excellent tools for mobile research applications like face-to-face interviews, diary studies and mystery shopping -- should be available at bargain prices while Palm makes room for new inventory.

Good going Palm! We knew you had it in you...