<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Joel Rubinson on Marketing Research &#187; Uncategorized</title>
	<atom:link href="http://blog.joelrubinson.net/category/uncategorized/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.joelrubinson.net</link>
	<description>ARF Chief Research Officer Joel Rubinson&#039;s Blog</description>
	<lastBuildDate>Tue, 27 Jul 2010 14:28:27 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=abc</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Marketing insights into how we decide</title>
		<link>http://blog.joelrubinson.net/2010/04/marketing-insights-into-how-we-decide/</link>
		<comments>http://blog.joelrubinson.net/2010/04/marketing-insights-into-how-we-decide/#comments</comments>
		<pubDate>Fri, 16 Apr 2010 16:06:18 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[behavioral economics]]></category>
		<category><![CDATA[branding]]></category>
		<category><![CDATA[marketing]]></category>
		<category><![CDATA[advertising]]></category>
		<category><![CDATA[ARF]]></category>

		<guid isPermaLink="false">http://blog.joelrubinson.net/?p=234</guid>
		<description><![CDATA[The decision before the decision might be the more important one for marketers.  Marketers need to learn about the opportunities inherent in influencing what are called second-order decision strategies. 

]]></description>
			<content:encoded><![CDATA[<p>The decision before the decision might be the more important one for marketers.  Marketers need to learn about the opportunities inherent in influencing what are called <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=193848">second-order decision strategies</a>. </p>
<p>Cass Sunstein, co-author of Nudge, created this idea which is about deciding how we are going to decide.  As an example (mine, not his), let’s say you want to buy a smart phone but know there are an overwhelming number of options.  You might manage this by doing a lot of research ahead of time (online, ask friends, observe what others have) to make it easier to decide when you get to the store.  That decision STRATEGY is your second order decision and what you actually buy when you get to the store is your first order decision.</p>
<p><strong>Shoppers can be segmented and targeted based on their second-order decision strategies. </strong>When we can repeatedly observe how a shopper decides, like in packaged goods, it is likely that a shopper mostly exhibits the same path to purchase for a given type of product, as their underlying decision strategy is likely to be very stable for a given product category. For example, if you know there are sales to be had on bottled water and you wait until an acceptable brand is on sale, you are a “system beater” (a term I helped to create in 1994).  That strategy of searching for sales becomes the core of the shopper’s second-order decision. The first-order decision becomes greatly simplified with that strategy (buy/not buy, how much).  Not all shoppers are system beaters (for example, some are highly brand loyal) suggesting that shoppers can be segmented on their decision strategies and marketed to in that way.</p>
<p><strong>Second-order decision making can be affected by marketing and the economy.</strong>  During the recession, I believe that many shoppers changed their second-order decisions.  People’s shopping patterns were greatly affected (more planned purchases and acceptance of store brands increased.) imagine the heuristic at point of purchase becoming “see if a national brand is on sale; compare price to the store brand”.  Dramatic increase in the use of coupons has been documented (highly intensive second-order decision-making/searching for sales that then simplifies the first order decision).  It is the changes in second-order decision strategies that have challenged the value proposition for national marketers. </p>
<p><strong>Do you want the brand decision in or out of the store?</strong> A national marketer with strong brands wants the brand decision to be made at the time the shopping trip is being planned, not in the store.  In other words, they have a strong preference for people using a PARTICULAR second-order decision. What are marketers doing to encourage the second-order strategy that benefits them?  How are their packaging and website encouraging consumers to simply use habit and replenishment as their decision strategy? If you are the new brand or a price brand, how are you DISCOURAGING people from doing that and encouraging shoppers to be more explorative?</p>
<p><strong>What type of second-order decision do you want people to use?</strong> I imagine that AT&amp;T and iPhone do not want people to have a high-effort second-order decision strategy.  They want people to just go to the AT&amp;T store and get the leading smart phone (iPhone).  Verizon and Motorola Droid should want people to get curious and to engage in much more information search; a highly engaged second-order decision approach.  In other words, the marketing battle needs to be fought on shaping people’s strategies for deciding and targeting those who have the preferred second-order decision strategy.</p>
<p>One way to get people to engage in a more evolved second-order decision process starts with the realization that it is a coping mechanism when people perceive many available choices.  This idea turns the Schwartz Paradox of Choice concept on its head.  Choice is NOT bad; people want choice to reflect their individuality (that’s why there is a long-tail of choices.) However, when there is a lot of choice, people cope by employing heuristics and second-order decisions to simplify the first-order decision.  Hence, more PERCEIVED choice leads to involved pre-planning. That is what iPhone COMPETITORS should want; get people to see the choices out there.  On the other hand,Apple should want to convince people there is really only one choice.  The battle is waged over the second-order decision strategy.</p>
<p>How can Apple (or any market leader) take a marketplace where there are many choices and make it one with few perceived options? Own the one thing that people should really care about. Taversky pioneered the concept of “elimination by aspects”; all items that don’t possess a certain desired feature are immediately put out of consideration. Dr.  Gerd Gigerenzer has documented many simplifying heuristics that people use, including “take the best” which describes an approach of focusing first on the attribute that is both the most important AND that differentiates the choices. We become blind to other choices.  That’s why Schwartz’ Paradox of Choice is misleading for marketers. </p>
<p><strong>How do we recognize?</strong> The final point I want to make today is the importance of understanding how we recognize things.  When the second-order decision carries the entire load, the planned purchase becomes a foregone conclusion.  Then, the retailer and manufacturer challenge shifts from influencing decisions to influencing recognition.  Gregory Bern, in his book “Iconoclast” talks about perception as a predictive system, where low level visual stimuli are interpreted via retained images and concepts. What cues will best connect your brand to this “predictive system” that people use to recognize things?</p>
<p>Behavioral economics has given us a new path to marketing opportunity.  Let’s study how people decide.</p>
<p><em>This is the second of two posts on applying behavioral economics to marketing issues.  <a href="http://blog.joelrubinson.net/2010/04/what-marketing-research-needs-to-learn-from-behavioral-economics/">The first posting is here</a>.</em></p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2010/04/marketing-insights-into-how-we-decide/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Fifteen issues Marketing was not discussing 15 years ago</title>
		<link>http://blog.joelrubinson.net/2010/03/fifteen-issues-marketing-was-not-discussing-15-years-ago/</link>
		<comments>http://blog.joelrubinson.net/2010/03/fifteen-issues-marketing-was-not-discussing-15-years-ago/#comments</comments>
		<pubDate>Sat, 27 Mar 2010 15:58:51 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[research transformation]]></category>
		<category><![CDATA[advertising]]></category>
		<category><![CDATA[ARF]]></category>
		<category><![CDATA[blogosphere]]></category>
		<category><![CDATA[branding]]></category>
		<category><![CDATA[data quality]]></category>
		<category><![CDATA[listening]]></category>
		<category><![CDATA[market research]]></category>
		<category><![CDATA[media]]></category>
		<category><![CDATA[shopper marketing]]></category>
		<category><![CDATA[social media]]></category>
		<category><![CDATA[storytelling]]></category>

		<guid isPermaLink="false">http://blog.joelrubinson.net/?p=232</guid>
		<description><![CDATA[Marketers must use new approaches and adopt a new corporate culture to become fast-learning organizations, or they will find their opportunities in the new normal defined by a future that is not of their own making.]]></description>
			<content:encoded><![CDATA[<p>Why did The ARF call <a href="http://www.thearf.org/assets/rethink-10">this year’s conference </a>succeeding in the new normal? How different is this year’s industry agenda from prior years or are we talking about the same stuff? The ARF annual conference agendas can be thought of as a chronicler of what the pressing issues are to the marketing and media communities. Because we keep all of our old brochures, I was able to look at the 1995 program. Here is a list of fifteen critical topics today that the industry wasn’t talking about at the ARF conference 15 years ago.</p>
<p>1. Mobile. Not mentioned in 1995 because it wasn’t thought of as an advertising or entertainment medium. Now mobile is at the top of everyone’s list to understand and measure better.</p>
<p>2. Set top box data. A compelling opportunity to get the granularity needed for media properties on the long-tail</p>
<p>3. Social media. Nuff said</p>
<p>4. The human. In 1995, we were focused on the consumer. As Stan Stanunathan from Coca-Cola says, when you focus on consumers you get incremental ideas. When you focus on humans you get breakthroughs.</p>
<p>5. Listening. Not a term the research community was using. Today it is central to generating future-focused insights and there were numerous presentations that leveraged the concept of listening.</p>
<p>6. Insights. In the 1995 brochure the word “insights” appeared only 4 times while the word “research” appeared 179 times. In 1995, we were still focused on the activities and craft of research.</p>
<p>7. Storytelling. This was the agency domain and only recently became a part of research impact</p>
<p>8. Sub-conscious mind. Especially on the biometrics panel, the idea that certain feelings, reactions, etc. are simply not accessible via the conscious mind. How do people make decisions? The model of the rational consumer has been forever overthrown.</p>
<p>9. Shopper. Shopper insights and shopper marketing are important parts of driving brand growth. They weren’t talked about at an advertising research event 15 years ago.</p>
<p>10. Long-tail. Amazon was just being founded in 1995 and before that, physical stores had limits to the choice they could offer. Unlimited choice via online retailers and media has created a level of market fragmentation never before seen.</p>
<p>11. Online research data quality. Online research didn’t really exist in 1995. Online research is such a dominant mode that the quality of the data must be beyond question.</p>
<p>12. We research. In 1995, each respondent was still a separate entity and not encouraged or even allowed to talk with anyone else. Now, firms are attempting to capture the dynamics of social interaction on individual choice in both quantitative research and communities.</p>
<p>13. Online and mobile video. Barely touched on in 1995 but now is a major force that every TV network needs to integrate into a 360 experience with their media properties. At first thought to be a threat to TV, now online and mobile video are thought to actually enhance engagement with the media property and increase TV viewing.</p>
<p>14. Multicultural is the new mainstream. We WERE talking in 1995 about how to conduct valid research among Hispanics but now it is mission critical. Non-Hispanic whites will be the minority in the US in 30 years and this has already happened in a number of major markets.</p>
<p>15. New business giants have emerged since 1995 that have changed the way people live their lives. The list includes: Google, Facebook, Twitter, My Space, LinkedIn, Flickr, Apple iTunes/iPhone/iPad/stores, Hulu, Youtube, Foursquare, Huffington Post, Techcrunch, Zappos, Fox News, Skype, Wikipedia, Firefox, DirecTV, Tivo, XM radio, NetFlix, Pandora.</p>
<p>Our lives are forever changed and are forever changing…truly there is a constantly changing new normal where the past is less and less predictive of the future. Marketers must use new approaches and adopt a new corporate culture to become fast-learning organizations, or they will find their opportunities in the new normal defined by a future that is not of their own making. Please take a minute to look at the video the ARF prepared, with the help of <a href="http://thinktopia.com/">Thinktopia</a>, entitled, “Inspiring Better Brands”.<br />
<object classid="clsid:d27cdb6e-ae6d-11cf-96b8-444553540000" width="480" height="385" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=6,0,40,0"><param name="allowFullScreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="src" value="http://www.youtube.com/v/BYfbjZmk2VQ&amp;hl=en_US&amp;fs=1&amp;" /><param name="allowfullscreen" value="true" /><embed type="application/x-shockwave-flash" width="480" height="385" src="http://www.youtube.com/v/BYfbjZmk2VQ&amp;hl=en_US&amp;fs=1&amp;" allowfullscreen="true" allowscriptaccess="always"></embed></object></p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2010/03/fifteen-issues-marketing-was-not-discussing-15-years-ago/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>How do online and RDD phone research compare? Latest findings&#8230;</title>
		<link>http://blog.joelrubinson.net/2009/09/how-do-online-and-rdd-phone-research-compare-latest-findings/</link>
		<comments>http://blog.joelrubinson.net/2009/09/how-do-online-and-rdd-phone-research-compare-latest-findings/#comments</comments>
		<pubDate>Thu, 10 Sep 2009 16:35:51 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[ARF]]></category>
		<category><![CDATA[data quality]]></category>
		<category><![CDATA[market research]]></category>

		<guid isPermaLink="false">http://blog.joelrubinson.net/?p=189</guid>
		<description><![CDATA[Recent evidence from over 100,000 interviews in a tightly controlled experiment proves online research, using best practices, can produce results that equally or more accurate vs. RDD phone interviewing on a series of benchmarking questions and demographics. ]]></description>
			<content:encoded><![CDATA[<p>The million dollar ARF Foundations of Quality study conducted in Oct/Nov 2008 involved over 100,000 interviews across 17 different online research panel providers, 1,000 RDD telephone interviews and 1,500 interviews conducted via mail panels.</p>
<p>As the ARF continues to release results, we want to share more insight on that important question here.</p>
<p>As can be seen in the two tables below, there is no clear pattern of RDD providing the more accurate answer vs. the average result from internet panel research on a series of benchmarking questions and demographics.  The biggest failures of RDD are in age of respondents and cell phone usage probably due to an increasing percentage (20% currently) of people in the US only having mobile phones and not having landlines.</p>
<table  border="1" cellspacing="0" cellpadding="2" width="560" >
<tbody>
<tr>
<td colspan="2" valign="top"><strong> </strong></td>
<td colspan="3" valign="top"><strong>Foundations of Quality </strong>(Oct–Nov ‘08) <strong><br />
    Raw</strong> (Un-projected)</td>
</tr>
<tr>
<td width="169" valign="top"><strong>Variable</strong></td>
<td width="132" valign="top"><strong>Us Census</strong><strong>Targets</strong></td>
<td width="145" valign="top"><strong>Online (17 panels)</strong></td>
<td width="42" valign="top"><strong>Mail</strong></td>
<td width="60" valign="top"><strong>Phone</strong></td>
</tr>
<tr>
<td valign="top"><strong>Gender</strong></td>
<td valign="top">&nbsp;</td>
<td valign="top">&nbsp;</td>
<td valign="top">&nbsp;</td>
<td valign="top">&nbsp;</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Male </td>
<td valign="top">49%</td>
<td valign="top">48%</td>
<td valign="top">44%</td>
<td valign="top">36%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Female</td>
<td valign="top">51%</td>
<td valign="top">52%</td>
<td valign="top">56%</td>
<td valign="top">64%</td>
</tr>
<tr>
<td valign="top"><strong>Education</strong></td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;HS or less</td>
<td valign="top">47%</td>
<td valign="top">24%</td>
<td valign="top">27%</td>
<td valign="top">29%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Some College</td>
<td valign="top">27%</td>
<td valign="top">43%</td>
<td valign="top">35%</td>
<td valign="top">35%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;4 year College +</td>
<td valign="top">26%</td>
<td valign="top">33%</td>
<td valign="top">34%</td>
<td valign="top">36%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;No response</td>
<td valign="top">&nbsp; </td>
<td valign="top">&#8212;</td>
<td valign="top">4%</td>
<td valign="top">&#8212;</td>
</tr>
<tr>
<td valign="top"><strong>Income</strong></td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Under $50K</td>
<td valign="top">43%</td>
<td valign="top">50%</td>
<td valign="top">35%</td>
<td valign="top">40%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;$50K – 99K</td>
<td valign="top">33%</td>
<td valign="top">33%</td>
<td valign="top">32%</td>
<td valign="top">24%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;$100K</td>
<td valign="top">24%</td>
<td valign="top">12%</td>
<td valign="top">18%</td>
<td valign="top">14%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Prefer not to   answer</td>
<td valign="top">&nbsp; </td>
<td valign="top">5%</td>
<td valign="top">12%</td>
<td valign="top">14%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;No response</td>
<td valign="top">&nbsp; </td>
<td valign="top">&#8211;</td>
<td valign="top">3%</td>
<td valign="top">8%</td>
</tr>
<tr>
<td valign="top"><strong>Race</strong></td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;White</td>
<td valign="top">84%</td>
<td valign="top">87%</td>
<td valign="top">81%</td>
<td valign="top">85%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Non-White</td>
<td valign="top">16%</td>
<td valign="top">12%</td>
<td valign="top">17%</td>
<td valign="top">10%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Prefer not to   answer&nbsp;&nbsp;</td>
<td valign="top">&nbsp; </td>
<td valign="top">1%</td>
<td valign="top">2%</td>
<td valign="top">5%</td>
</tr>
<tr>
<td valign="top"><strong>Marital Status</strong></td>
<td valign="top">NA</td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Married</td>
<td valign="top">&nbsp; </td>
<td valign="top">57%</td>
<td valign="top">70%</td>
<td valign="top">58%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Not Married</td>
<td valign="top">&nbsp; </td>
<td valign="top">43%</td>
<td valign="top">28%</td>
<td valign="top">41%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;No Response</td>
<td valign="top">&nbsp; </td>
<td valign="top">&#8212;</td>
<td valign="top">2%</td>
<td valign="top">1%</td>
</tr>
<tr>
<td valign="top"><strong>Age (mean)</strong></td>
<td valign="top">45</td>
<td valign="top">45.7</td>
<td valign="top">46.6</td>
<td valign="top">54.1</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;18-29</td>
<td valign="top">22%</td>
<td valign="top">18%</td>
<td valign="top">12%</td>
<td valign="top">9%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;30-39</td>
<td valign="top">18%</td>
<td valign="top">20%</td>
<td valign="top">20%</td>
<td valign="top">11%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;40-49</td>
<td valign="top">20%</td>
<td valign="top">20%</td>
<td valign="top">20%</td>
<td valign="top">21%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;50-64</td>
<td valign="top">24%</td>
<td valign="top">26%</td>
<td valign="top">26%</td>
<td valign="top">32%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;65+</td>
<td valign="top">16%</td>
<td valign="top">16%</td>
<td valign="top">22%</td>
<td valign="top">27%</td>
</tr>
</tbody>
</table>
<table style="margin-top: 20px;" border="1" cellspacing="0" cellpadding="2" width="560" >
<tbody>
<tr>
<td colspan="2" valign="top"><strong> </strong></td>
<td colspan="3" valign="top"><strong>Foundations   of Quality</strong> (Oct–Nov &#8216;08)<strong><br />
&#8220;Best Practice&#8221; Weighting</strong></td>
</tr>
<tr>
<td width="207" valign="bottom"><strong>Variable</strong></td>
<td width="114" valign="bottom"><strong>Available   Benchmark</strong></td>
<td width="134" valign="bottom"><strong>Online   (17 panels)</strong></td>
<td width="38" valign="bottom"><strong>Mail</strong></td>
<td width="55" valign="bottom"><strong>Phone</strong></td>
</tr>
<tr>
<td valign="bottom"><strong>Own   Home</strong></td>
<td>68%</td>
<td>68%</td>
<td>76%</td>
<td>79%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>Census/AFF</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Ever   Smoked</strong></td>
<td>41%</td>
<td>51%</td>
<td>43%</td>
<td>46%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Now   Smoke</strong></td>
<td>21%</td>
<td>26%</td>
<td>21%</td>
<td>21%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Residential   Phone</strong></td>
<td>80%</td>
<td>84%</td>
<td>84%</td>
<td>100%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Own   Cell Phone</strong></td>
<td>79%</td>
<td>89%</td>
<td>88%</td>
<td>79%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>%   Calls Received on Cell Phone</strong></td>
<td>41%</td>
<td>39%</td>
<td>39%</td>
<td>26%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
</tbody>
</table>
<p>While a research supplier can weight data (also called “post-stratification”), the demographic imbalances from RDD are problematic. The more skewed the sample is, the more extreme the weights, the lower the “RIM efficiency”.  This is an important statistic as it tells you the effective sample size.  For example, an ending sample of 1,000 and a RIM efficiency statistic of 40% implies that your sample has the variability of a sample of 400.
<p>Clearly all modes have their challenges and require their own custom-tailored best practices to produce trustworthy information.  Even in the world of political polling, RDD interviewing methods can produce very different results and might not be as accurate as well-designed online research.  Professor Costas Panagopoulos from Fordham’s Political Science Dept analyzed the accuracy of 23 presidential polls regarding the 2008 presidential election.  While nearly all polls use RDD telephone methods, the one poll I recognize as an online poll actually finished third in accuracy (ahead of 20 or so RDD-based polls).  Also, 17 of 23 polls OVERESTIMATED Obama’s margin of victory, indicating a clear bias from RDD polling.  Interestingly, some of the best known polls (e.g. from the original national networks and Gallup finished at the bottom of the list.</p>
<p>Recently an old 2004 study that also compares online to RDD research managed out of Stanford University has resurfaced with some re-analysis of the 5 year old dataset.  Due to the rapid rise of cell-phone only individuals and the apparent failure to employ what would be considered best practice today regarding pre-stratification of online samples, this study is of limited relevance today. <a href="http://www.pollster.com/blogs/doug_rivers.php">(See pollster.com.) </a></p>
<p>Our evidence from Foundations of Quality is that online research can produce comparable, consistent, and accurate data if proper practices are implemented.  If not, for example, if we do not control for sample source, a project can yield data that are not useful.  <a href="http://www.thearf.org/assets/online-research-quality-council">On Sept 29<sup>th</sup>, the ARF will share</a> a process we have co-created with industry leadership that will allow buyer and seller to work collaboratively to produce online research that can be used with confidence to inform marketing decision making.  This meeting is open to all, including the press.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2009/09/how-do-online-and-rdd-phone-research-compare-latest-findings/feed/</wfw:commentRss>
		<slash:comments>10</slash:comments>
		</item>
		<item>
		<title>The commitment to Storytelling at Levi, Strauss</title>
		<link>http://blog.joelrubinson.net/2009/06/the-commitment-to-storytelling-at-levi-strauss/</link>
		<comments>http://blog.joelrubinson.net/2009/06/the-commitment-to-storytelling-at-levi-strauss/#comments</comments>
		<pubDate>Mon, 01 Jun 2009 12:48:12 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[research transformation]]></category>
		<category><![CDATA[conversation]]></category>
		<category><![CDATA[innovation]]></category>
		<category><![CDATA[learning]]></category>
		<category><![CDATA[Levi]]></category>
		<category><![CDATA[Levi Strauss]]></category>
		<category><![CDATA[listening]]></category>
		<category><![CDATA[market research]]></category>
		<category><![CDATA[storytelling]]></category>

		<guid isPermaLink="false">http://rubinson.wordpress.com/?p=139</guid>
		<description><![CDATA[Here is an interview with Michael Perman, Senior Director of Consumer Insights, Levi Strauss &#38; Co.  who has trained over 7,000 on storytelling and who is conducting, with Pat Hanlon, the ARF Workshop, “Stories Inspire” on June 22nd in NY.  The interview with Pat Hanlon can be found here.
Joel: Michael, you are a [...]]]></description>
			<content:encoded><![CDATA[<p><em>Here is an interview with Michael Perman, Senior Director of Consumer Insights, Levi Strauss &amp; Co.  who has trained over 7,000 on storytelling and who is conducting, with Pat Hanlon, <a href="http://thearf.org/assets/arf-university">the ARF Workshop, “Stories Inspire” on June 22nd in NY</a>.  The interview with <a href="http://rubinson.wordpress.com/2009/05/20/cracking-the-code-creating-great-brands/">Pat Hanlon can be found here</a>.</em><br />
Joel: Michael, you are a huge proponent of storytelling to convey insights, having said that “stories inspire”.  What is your best story that shows this? A story about a story, so to speak…<br />
Michael Perman: I arrived in Willamette Valley, Oregon in the grey days of winter 1986, having been sent there from &#8220;headquarters&#8221; to be marketing director for a failing but sizeable beef jerky company.  The team there was mired in the past and sales were languishing.  Analysis of the data yielded no insights, other than small, local competitors were gaining on us&#8230;and that was a clue.  I spent about three months riding in trucks with small jobbers who sold candy, tobacco and jerky.  What an interesting aroma.  I met the owners of small convenience stores in small farm and lumber towns. I also met the people who shopped in those stores. About two months into the journey we learned about Hershey&#8217;s selling big and thick chocolate bars that provided better value to consumers.  Those big sizes were doing really well.  The insight was that mobile consumers&#8217; appetites for larger sized snacks were growing.  So, we created a brand called &#8220;Long Haul&#8221; that made giant sized snacks for people on the go.  We designed a counter display that looked like a truck and developed a few TV ads.  Sales soared and we ended up selling the company for a nice gain.  I fell in love with research.</p>
<p>Joel: Can stories be used to convey quantitative research findings too?<br />
Michael Perman: Yes, but it&#8217;s a matter of focusing on a small number of facts that are truly meaningful.  Maybe even on specific metric about consumption or equity.  Too many reports try to cover too much ground and people lose sight of the big ideas.  Also, facts sometimes need to be validated with human connections&#8230;not always the other way around.</p>
<p>Joel: Can you describe the training you do at Levi Strauss and how it impacts the organization?<br />
Michael Perman: We&#8217;ve trained more than 7,000 employees around the world on developing innovation from insights.  We&#8217;ve taught them how to observe and listen to consumers, how to tell stories about their experiences and how to synthesize cogent themes.  Empathy is a company value.  That ethos helps us get grounded in the reality of our consumers’ lives.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2009/06/the-commitment-to-storytelling-at-levi-strauss/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Proving the value of listening&#8230;ABOUT Research</title>
		<link>http://blog.joelrubinson.net/2009/05/proving-the-value-of-listening-about-research/</link>
		<comments>http://blog.joelrubinson.net/2009/05/proving-the-value-of-listening-about-research/#comments</comments>
		<pubDate>Tue, 26 May 2009 22:13:53 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[listening]]></category>
		<category><![CDATA[ARF]]></category>
		<category><![CDATA[customer care]]></category>
		<category><![CDATA[market research]]></category>
		<category><![CDATA[social media]]></category>

		<guid isPermaLink="false">http://rubinson.wordpress.com/?p=137</guid>
		<description><![CDATA[I came across a really interesting exchange of comments on Flickr (not Facebook or My Space or Twitter) from an irate person who joined an online research panel.  There are 3 great lessons here:
1—how lack of dialogue can lead to a tremendous level of misinterpretation then distrust about a business’ motives,  leading to [...]]]></description>
			<content:encoded><![CDATA[<p>I came across a really interesting exchange of comments on Flickr (not Facebook or My Space or Twitter) from an irate person who joined an online research panel.  There are 3 great lessons here:<br />
1—how lack of dialogue can lead to a tremendous level of misinterpretation then distrust about a business’ motives,  leading to active animosity<br />
2—how people want to be heard and how conversation can explain, and calm these feelings before they get toxic and go viral<br />
3—how important a commitment to listening is, or this never would have been caught.<br />
OK, here is the conversation (slightly shortened but not too much so I could preserve the flavor):<br />
<strong>IRATE ONLINE RESEARCH PANELIST</strong><br />
I am posting this to warn you about this company called XYZ Research. They are a market research firm that conducts polls and surveys for their clients.</p>
<p>I am taking the time to write about this and warn you about them.</p>
<p>…But the worst part is the feeling of being lied to, being deceived and cheated upon. I&#8217;d like to spare you this experience, so bear with me.</p>
<p>To make matters worse, I was getting many invites to surveys that were obviously not addressing me. Usually, when you begin a survey, there are a couple of questions to find out if you&#8217;re part of the target audience. If you&#8217;re not, the survey ends and you get no reward points.</p>
<p>Fair enough, but usually I had already answered quite a lot of questions, giving out personal information which is extremely valuable for market researchers, before being told that I didn&#8217;t &#8220;fit in&#8221;. To me, it seemed like a scam: grab my personal info off me, and then tell me to bugger off. We just took your data, but no, you&#8217;re not getting any reward.</p>
<p>Sometimes, they would just kick me out because &#8220;the number of participants had already been reached&#8221;. Fine, but why do they make me answer part of the survey and then suddenly find out they already have enough of them? Things were starting to smell rather fishy.</p>
<p>So what about those product tests they talked about when they enticed me to register with them? But now I&#8217;m thinking nobody who registered with XYZ Research probably ever received anything.</p>
<p>They took my data and sold it to a couple of big-money companies. I got no reward. I feel lied to and cheated upon.</p>
<p>Today, I deleted my account. I have no idea what they are going to do with my personal data.</p>
<p>I got this e-mail confirmation (screenshot above), and it says it will take them a couple of weeks to delete my account. They must be joking: deleting an account is a database operation that takes a fraction of a second.</p>
<p>To me, XYZ Research is a scam operation. Don&#8217;t fall for them. I&#8217;ve certainly learned my lesson.</p>
<p>Pass this on to your friends to warn them if you think they&#8217;d fall into XYZ Research&#8217;s clutches.</p>
<p><strong>EMPLOYEE RESPONSE</strong>Dear Mr.</p>
<p>I work for XYZ Research.com.</p>
<p>We have seen your post on Flickr and feel very concerned about what you have said and of course by how disappointed you have been by our services.</p>
<p>XYZ Research is a panel operator that works with the biggest market research agencies in the world and is a listed company that employs nearly xxx  people worldwide</p>
<p>Data privacy is at the heart of our business so we would like to ensure you that when you answer a survey on XYZ Research, your data are transferred to our clients in a anonymous way for statistical purposes only. If you cannot finish a survey for any reason, your questionnaire is considered as incomplete and your data is not transferred. Even XYZ Research does not keep this data.</p>
<p>After a member unsubscribes from our panel, all your data are removed from our database after 6 months (this is in case there has been an error and the user wishes to reopen their account). You can also request from us that all your data be removed immediately.</p>
<p>Cancellation of an account is immediate but in the past due to technical problems, some members have received emails from us a couple days after they unsubscribe. In order to prevent frustration in this unfortunate case, we have decided to tell users that the complete unsubscription process can take up to two weeks to avoid any bad surprises, even if this is very unlikely</p>
<p>Surveys work with quotas for statistical reasons. For example if the study requests 100 men aged 25-35 years old, if you try to finish the survey as the 101st person, the survey will close. It is impossible to invite only the exact number of respondents required, as response to surveys from respondents can vary according to many criteria (day, time, target, weather,..)</p>
<p>We try to keep the surveys below 20 minutes and we strongly recommend that our clients do so too, we also oppose surveys that would take more than 45 min to answer.</p>
<p>The number of products to test is shown on the test product page together with the list of testers. You can also check the opinion sections where testers write reviews about the product they received from XYZ Research.</p>
<p>XYZ Research is not really a place to make money. Our reward schemes simply aim to thank our members for giving their opinion and helping brands to improve their product and services. Nevertheless we send thousands of gift vouchers every week to our members and this is a very significant cost of our activity.</p>
<p>Once again we are very sorry that you didn’t enjoy your memberships on XYZ Research as many members have done worldwide over the last 8 years now, and hope that this email has clarified some important issues regarding our service.</p>
<p><strong>RESULT (PEOPLE WANT TO BE HEARD)</strong>Thanks, Laurent, for taking the time to reply to my post. It is much appreciated that there is a human being at your company who listens to users.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2009/05/proving-the-value-of-listening-about-research/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
