• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

5 Circles Research

  • Overview
  • SurveysAlaCarte
  • Full Service
  • About
  • Pricing Gurus
  • Events
  • Blog
  • Contact

Pricing Gurus and 5 Circles Research Blog Posts

Why Market Researchers should care about bandwidth

The Pew Research Center has tracked broadband adoption for several years; the most recent study shows that the adoption rate has dropped. As of April 2008, 55% of the adults in the U.S. have access to broadband at home, with just 10% using dial-up connections.

As you might imagine, broadband usage is unevenly distributed. People living in rural areas are less likely to have a high speed connection, as are lower income and African Americans (Hispanic broadband access is similar to the overall population). Notably, broadband adoption now increases with age, with the highest rate among those 65 and above.

All very interesting you might say, but what’s the point for me as a researcher or marketer? When I dug deeper into the report, I found some nuggets about why broadband isn’t being used that lead to implications about research and product. Here are a couple of points to ponder:

  • Some people say they don’t want broadband. Of course, availability and cost are issues for some, but 19% say that nothing would convince them to get broadband. I’m sure that some of the naysayers would actually become subscribers if they were to try broadband (most marketing still focuses on speed, ignoring the benefits of an always-on connection), but there will still be some who won’t make the move of their own volition. Slowing adoption rates confirm that these people aren’t just late adopters, they are laggards, and they will probably only convert when forced by suppliers. As we know from the Technology Adoption LifeCycle model, the stages correlate to different psychographic profiles. These people are different!
  • Many of those who want broadband do not have access (particularly in rural areas), or cannot afford it. This has implications for the design and implementation of market research.
  • Beyond the broadband versus dial-up split, 35% of adult Americans do not have any form of Internet access at home. The most significant demographic differences shown in the Pew report summarizes are age, income, and education – truly a digital divide.

Lessons for marketers and researchers

  1. You still need to consider bandwidth capabilities for online surveys. Perhaps your research topic is such that you don’t care if you deter dial-up users, but often you should be concerned about non-response bias, and in any case the things that improve surveys for lower bandwidth are good practice for all. In particular,
    • Combine pages when it makes sense. We’ve all seen surveys that have every question on a new page with no good reason. Every page load takes more time for a dial-up user. Sometimes your logic requires a new page (but be careful when choosing a tool that you aren’t forced into poor practices just because of the tool), but it is usually possible to put a few questions together with the result looking better for the responder. Demographics and related satisfaction questions are good candidates, but try especially hard to make the front of the survey look good when viewed over a slower connection. Note that the advice to combine pages doesn’t just mean put everything on a single page. Remember, you are trying to engage the respondent. Think of the survey like a conversation. A long single page online survey can be very daunting, and almost as frustrating as endless clicks.
    • Make your graphics small files. There’s nothing wrong with some graphical elements for branding or just to make the pages more interesting, but be sure to keep the files small. That great picture of the product was probably taken with a multi-megapixel camera, meaning that the file is hundreds of kilobytes. But it doesn’t need to be very high resolution, regardless of the speed of the connection; 72dpi is probably plenty.
    • Avoid gratuitous or physically large graphics, for the same reason as the previous recommendation. Your respondents are doing you a favor, so don’t show them images just because you think they make the survey more interesting.
  2. Is an online survey really the best approach? Usually online surveys work very well, but don’t be blind to other techniques. Is your target market online? If your product is aimed at one of the demographics that are underrepresented online you may be increasing the potential for bias. Weighting and oversampling might be helpful, but could increase costs and you may miss out on insights from some of the key targets. Even if you are surveying existing customers (rather than using a panel) be aware of the potential for problems, especially if your email coverage isn’t representative. Perhaps telephone or mail data collection would allow you to better reach the full range of psychographic profiles.
  3. Match your marketing to your targets. No surprise here, but remember a couple of things. Your customers may be looking at your messages online, just not at home, by using the Internet in the library or at work. [Side note – speedy access is one reason why online shopping at work is popular at lunchtime.] Don’t alienate the less technically attuned consumers. Differentiated advertising through different media is probably a good idea.

As with many other aspects of research and marketing in general, the real message here is to think, not assume. Try to put yourself in the mind of your respondents, prospects, and customers.

Idiosyncratically,
Mike

Filed Under: Methodology, Surveys

Why don’t surveys support Firefox?

I asked myself this question the first time I saw a survey invitation with the following warning:

Please note, this survey contains media that is not compatible with Firefox Internet Browser

The invitation continued with instructions to copy and paste the link into an Internet Explorer window if Firefox is my default browser.

Let’s look at this in more detail. To dispose of the title question first, the only obvious logical reason why someone fielding online surveys wouldn’t provide support for Firefox users would be if they were surveying people who don’t use it. Perhaps even that isn’t exactly logical, but at least it’s a reasonable excuse. If you are creating something that requires significant development effort, and you are screening for Internet Explorer users, why bother with Firefox?

Unfortunately, that theory doesn’t fit the situation. I’ve seen invitations with this warning for over a year, covering Consumer Package Goods and Retail Stores. I have yet to come up with a good reason, and the research company hasn’t offered me one.

But why is it such a bad idea?

First, Sample Bias. Systematically excluding a segment of the overall population you want to survey is generally a bad practice. It is easy to gather results that are biased, for reasons that may be obvious or less so.

Remember the days of telephone surveys? (I know, we are still collecting data via the telephone, but many people are only familiar with online surveys.) Best practices include calling at random times of the day and night, and also letting the phone ring for quite a while. Why? To increase the chances of the respondent being a person who works, and also to increase the coverage of people who might be elderly or infirm – and who might take longer to reach the phone. Without these measures, you might end up with a disproportionately large number of fit stay-at-home respondents. Some corrections could be done with weighting, but this adds unnecessary complexity versus just improving the representivity of the sample in the first place.

In the case of eliminating surveys from Firefox users, it would probably be a good idea to understand the potential impact through browser share numbers. Unfortunately, this isn’t quite as easy as it might seem, which is probably why we see percentages ranging from 14% to several times higher for Firefox usage in the US. These differences are caused by data collection methodologies and also browser behavior, but this article isn’t about browser share so let’s just settle on an approximation of 20% user share for Firefox. So these surveys are systematically excluding about one fifth of the US population. I could easily come up with some imagined differences  between Firefox users and users of other browsers, but fortunately there is some real research out there. comScore reported in 2007 on a study that looked into the differences between Firefox and Internet Explorer users. The results showed that Firefox users were more likely to be younger, higher income, and male than the average Internet user. Would this impact a project covering food items in the grocery store? You bet. comScore’s study also showed that Firefox users are more likely to have a broadband connection and that their site visitation profile varied from the average – which could impact advertising placement and content.

The other impact for concern, although probably a lesser concern in this case than sample bias, is that of Lower Response Rates. Without hard evidence we can only speculate on the impact, but it seems likely that some people who receive an invitation excluding Firefox might decide not to participate even though they could do so fairly easily by starting Internet Explorer and pasting the link. The additional steps involved are a deterrent. Unfortunately, these particular surveys don’t even work by changing to Internet Explorer rendering within Firefox (something that is common practice to allow usage of sites that are not standards compliant). Longer term, continued invitations that are less easy to use may result in more people leaving the panel.

In conclusion, make your surveys sample as representative as possible, and don’t do anything in the invitation or survey to turn people off.

One last note on this subject. The problem invitations specifically state that the surveys don’t work with Firefox. Even if Firefox is the only excluded browser, it represents over 20% of the overall market as of Dec 2008 according to Net Applications.  It probably doesn’t make sense to invest in development for older browsers, but as Safari (7.9%) and Chrome (1%) usage grows the challenges for survey developers are going to increase.  Overall, browsers other than Internet Explorer are currently about one-third of total usage.

Idiosyncratically,
Mike Pritchard
5 Circles Research

Filed Under: Methodology, Questionnaire, Surveys

  • « Go to Previous Page
  • Go to page 1
  • Interim pages omitted …
  • Go to page 4
  • Go to page 5
  • Go to page 6

Primary Sidebar

Follow us on LinkedIn Subscribe to Blog via RSS Subscribe to Blog via Email
Many thanks to you for the very helpful presentation on pricing last night. I found it extremely useful and insightful. Well worth the drive down from Bellingham!
G.FarkasCEOTsuga Engineering
Every conversation with Mike gave me new insight and useful marketing ideas. 5 Circles’s report was invaluable in deciding on the viability of our new product idea.
Greg HowePresidentCD ROM Library, Inc.
When you work with a market research company you normally have to define the questions. 5 Circles Marketing’s staff have technical backgrounds, so it’s a lot easier to work with them.
Lorie WigleProduct Line Manager, Business Communications DivisionIntel Corporation
Mike did multiple focus groups for me when I was at Amazon, and I was extremely pleased with the results. Not only is Mike an excellent facilitator, he also really understood the business problem and the customer experience challenges, and that got us to excellent and very actionable results.
Werner KoepfSenior ManagerAmazon.com
You know how your mechanic knows what’s wrong with your car when you just tell them what it sounds like over the phone? Well, my first conversation with Mike was like that — in like 10 seconds, he gave me an insight into my market research that was something I’d been struggling trying to figure out. A class like this will help you learn what you can do on your own. And, you’ll have a better idea of what a research vendor can do for you.
Roy LebanFounder and CTOPuzzazz
Mike brings a tremendous balance of theoretical marketing research with a strong practical knowledge of marketing. He can tailor the research to the right level for your project. I have hired Mike multiple times and he has delivered each time. I would hire him again.
Rick DenkerPresidentPacket Plus
Since becoming our contracted consultant for market research services in 2010, 5 Circles Research has revolutionized our annual survey of consumer opinion in Washington. Through the restructuring of survey methodology and the application of new analytical tools, they have provided insights that are both wider in their scope and deeper in their relevance for understanding consumer values and behavior. As a result, the survey has increased its significance as a planning and evaluation tool for our entire state agency. 5 Circles does great work!
Blair ThompsonDirector of Consumer CommunicationsWashington Dairy Products Commission
What we were doing was offering not just a new product, but a new market niche. We needed to understand traditional markets well to characterize the new one. Most valuable was 5 Circles ability to gather research data and synthesize it.
Will NeuhauserPresident Chorus Systems Inc.
I hired Mike to develop, execute and report on a market research project involving a potential business opportunity. I was impressed with his ability to learn the industry and subsequently develop a framework for the market research project. He was able to execute the research and collect data efficiently and effectively. Throughout the project, he kept me abreast of the progress to allow for any adjustments as needed. The quality and quantitative output of the results exceeded my expectations and provided me with more confidence in the direction of the business opportunity.
Mike ClaudioVice President Marketing and Business DevelopmentWizard InternationalSeattle
Great workshop! You know this field cold, and it’s refreshing to see someone focused on research for entrepreneurs.
Maria RossOwnerRed Slice

Featured Posts

Dutch ovens: paying a lot more means better value

An article on Dutch ovens in the September/October 2018 of Cook’s Illustrated gives food for thought (pun intended) about the relationship of between price and value. Sometimes higher value for a buyer means paying a lot more money – good news for the seller too. Dutch ovens (also known as casseroles or cocottes) are multipurpose, [Read More]

Profiting from customer satisfaction and loyalty research

Business people generally believe that satisfying customers is a good thing, but they don’t necessarily understand the link between satisfaction and profits. [Read More]

Customer satisfaction: little things can make a big difference

Unfulfilled promises by the dealer and Toyota of America deepen customer satisfaction pothole. Toyota of America and my local dealer could learn a few simple lessons about vehicle and customer service. [Read More]

Are you pricing based on cost rather than value? Why?

At Pricing Gurus, we believe that value-based pricing allows companies to achieve higher profitability and a better competitive position. Some companies disagree with that perspective, or feel they are stuck with cost-based pricing. Let’s explore a few reasons why value-based pricing is generally superior. [Read More]

Recent Comments

  • Mike Pritchard on Van Westendorp pricing (the Price Sensitivity Meter)
  • Marshall on Van Westendorp pricing (the Price Sensitivity Meter)
  • Manik Balaam on Dutch ovens: paying a lot more means better value
  • 📕 E mail remains to be the most effective SaaS advertising channel; Chilly emails that work for B2B; Figuring out how it is best to worth… - hapidzfadli on Van Westendorp pricing (the Price Sensitivity Meter)
  • Soumyak on Van Westendorp pricing (the Price Sensitivity Meter)

Categories

  • Overview
  • Contact
  • Website problems or comments
Copyright © 1995 - 2025, 5 Circles Research, All Rights Reserved