<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Joel Rubinson on Marketing Research &#187; Uncategorized</title>
	<atom:link href="http://blog.joelrubinson.net/category/uncategorized/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.joelrubinson.net</link>
	<description>Marketing and Research Consulting for a Brave New World</description>
	<lastBuildDate>Mon, 30 Jan 2012 14:12:18 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=abc</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Does your brand have a cold wet nose?</title>
		<link>http://blog.joelrubinson.net/2010/08/does-your-brand-have-a-cold-wet-nose/</link>
		<comments>http://blog.joelrubinson.net/2010/08/does-your-brand-have-a-cold-wet-nose/#comments</comments>
		<pubDate>Thu, 12 Aug 2010 14:27:26 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[branding]]></category>
		<category><![CDATA[brand equity]]></category>
		<category><![CDATA[brand health]]></category>
		<category><![CDATA[brand loyalty]]></category>
		<category><![CDATA[market research]]></category>
		<category><![CDATA[marketing]]></category>
		<category><![CDATA[research transformation]]></category>

		<guid isPermaLink="false">http://blog.joelrubinson.net/2010/08/does-your-brand-have-a-cold-wet-nose/</guid>
		<description><![CDATA[Brand equity refers to the size of a brand; brand health refers to its trajectory.  Here are  8 signs if your brand is healthy.]]></description>
			<content:encoded><![CDATA[<p>Many use the terms brand equity and brand health interchangeably; they shouldn’t.</p>
<p>Brand equity refers to the size of a brand.  A brand with high brand equity has lots of customers, big market share, and a presence in the marketplace that leads one to believe that it will stay big.  Take two brands—Microsoft and Apple.  Both have lots of brand equity and because the corporate name is the brand, we can think of market cap as reflective of brand equity.  I am an outsider to both firms but I think the marketplace would believe that the trajectory of the two brands is somewhat different at this point.  Their brand health is different.</p>
<p>So, let’s think about brand health.  When <a href="mailto:David.Meer@booz.com">David Meer</a> and I worked together at The NPD Group, we had an impromptu “Synectics-style excursion” one day to explore the meaning of brand health by thinking about how you can tell if your dog is healthy.</p>
<p>Signs your dog is healthy</p>
<ul>
<li>Has a normal appetite</li>
<li>Comes when you call it</li>
<li>Looks like the breed it is</li>
<li>Heals fast</li>
<li>Puppies need to grow into their paws to normal size</li>
<li>Has a bright, shiny coat</li>
<li>Doesn’t have accidents in the house </li>
<li>Cold, wet nose</li>
</ul>
<p>So, following the metaphor, here are the signs that your brand is healthy</p>
<table border="1" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td width="211" valign="top">
<p>Dog is healthy if:</p>
</td>
<td width="427" valign="top">
<p>Brand is healthy if</p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Has a normal appetite</p>
</td>
<td width="427" valign="top">
<p>Brands “eat” Advertising and promotion support.  If the brand needs to increase marketing   support, especially promotion support, to maintain market share it’s not a   healthy sign</p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Comes when you call it</p>
</td>
<td width="427" valign="top">
<p>Does your brand come when consumers call?  Are they “calling it” (via social media   conversations).  Is the marketing team   listening and responding?</p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Looks likes the breed it is</p>
</td>
<td width="427" valign="top">
<p>Does your brand have the meaning to consumers it intends to have? Is it   positioned as intended?</p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Heals fast</p>
</td>
<td width="427" valign="top">
<p>Good brands can receive bad news that, in an era of social media, can   turn into massive body blows in an instant.    One of the most powerful signs of brand equity is that your customers   will forgive you; is your brand bouncing back?</p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Puppies need to grow into their paws to normal size</p>
</td>
<td width="427" valign="top">
<p>Is your brand growing the way it should?  Are you aware of the geometry of a brand,   the signs across multiple information streams that it has grown to full   size?  For example, high penetration or   trial that is not supported by commensurate customer retention means the   brand will stop growing short of its full size.  This was the point that Nielsen made about   Twitter a year or so ago.</p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Has a bright shiny coat</p>
<p><br class="spacer_" /></p>
</td>
<td width="427" valign="top">
<p>Dogs’ coats shine, making them attractive from a distance.  In the era of shopper marketing, nothing   could be more important than having your brand jump off the shelf and tells   shoppers in an instant what it is about.</p>
<p><br class="spacer_" /></p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Doesn’t have accidents</p>
<p><br class="spacer_" /></p>
</td>
<td width="427" valign="top">
<p>Well, no brand team wants to be fighting fires and cleaning up after   the brand.  Brands are about trust and   therefore consistency.  You should be   able to have exactly the brand experience you expect, or better.  If your brand has inconsistent quality or train   wrecks it will keep the brand team on defense.</p>
</td>
</tr>
<tr>
<td width="211" valign="top">
<p>Cold wet nose</p>
</td>
<td width="427" valign="top">
<p>Touching your dog’s nose regularly is a way of tracking if it is   healthy or if you have to look further.    In this digital age, track your brand in all layers of consumer   expression: surveys, social media, search, activity in owned media, etc.</p>
</td>
</tr>
</tbody>
</table>
<p><br class="spacer_" /></p>
<p>So, we’re not talking about the size of the dog, we’re talking about if it’s healthy.  Brand health is critical to understand and measure because it is predictive of the future.  A big brand that is unhealthy won’t stay that big for long.</p>
<p>OK, that brings me to my final point.  At the ARF Research Transformation initiative, we talk about “The River”.   Today in our digital society there is a constant river of information that is fed by numerous tributaries.  The river is flowing continuously so conversation about your brand and people’s needs don’t happen on your schedule but on theirs.  Someone can search for your brand (or a competitor) anytime they choose to. Today, tracking surveys alone are not enough to fully understand brand health.   We must also look in the river and consider ALL the signs and signals in a digital age to see if your brand has a cold wet nose.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2010/08/does-your-brand-have-a-cold-wet-nose/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Marketing insights into how we decide</title>
		<link>http://blog.joelrubinson.net/2010/04/marketing-insights-into-how-we-decide/</link>
		<comments>http://blog.joelrubinson.net/2010/04/marketing-insights-into-how-we-decide/#comments</comments>
		<pubDate>Fri, 16 Apr 2010 16:06:18 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[behavioral economics]]></category>
		<category><![CDATA[branding]]></category>
		<category><![CDATA[marketing]]></category>
		<category><![CDATA[advertising]]></category>
		<category><![CDATA[ARF]]></category>

		<guid isPermaLink="false">http://blog.joelrubinson.net/?p=234</guid>
		<description><![CDATA[The decision before the decision might be the more important one for marketers.  Marketers need to learn about the opportunities inherent in influencing what are called second-order decision strategies. 

]]></description>
			<content:encoded><![CDATA[<p>The decision before the decision might be the more important one for marketers.  Marketers need to learn about the opportunities inherent in influencing what are called <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=193848">second-order decision strategies</a>. </p>
<p>Cass Sunstein, co-author of Nudge, created this idea which is about deciding how we are going to decide.  As an example (mine, not his), let’s say you want to buy a smart phone but know there are an overwhelming number of options.  You might manage this by doing a lot of research ahead of time (online, ask friends, observe what others have) to make it easier to decide when you get to the store.  That decision STRATEGY is your second order decision and what you actually buy when you get to the store is your first order decision.</p>
<p><strong>Shoppers can be segmented and targeted based on their second-order decision strategies. </strong>When we can repeatedly observe how a shopper decides, like in packaged goods, it is likely that a shopper mostly exhibits the same path to purchase for a given type of product, as their underlying decision strategy is likely to be very stable for a given product category. For example, if you know there are sales to be had on bottled water and you wait until an acceptable brand is on sale, you are a “system beater” (a term I helped to create in 1994).  That strategy of searching for sales becomes the core of the shopper’s second-order decision. The first-order decision becomes greatly simplified with that strategy (buy/not buy, how much).  Not all shoppers are system beaters (for example, some are highly brand loyal) suggesting that shoppers can be segmented on their decision strategies and marketed to in that way.</p>
<p><strong>Second-order decision making can be affected by marketing and the economy.</strong>  During the recession, I believe that many shoppers changed their second-order decisions.  People’s shopping patterns were greatly affected (more planned purchases and acceptance of store brands increased.) imagine the heuristic at point of purchase becoming “see if a national brand is on sale; compare price to the store brand”.  Dramatic increase in the use of coupons has been documented (highly intensive second-order decision-making/searching for sales that then simplifies the first order decision).  It is the changes in second-order decision strategies that have challenged the value proposition for national marketers. </p>
<p><strong>Do you want the brand decision in or out of the store?</strong> A national marketer with strong brands wants the brand decision to be made at the time the shopping trip is being planned, not in the store.  In other words, they have a strong preference for people using a PARTICULAR second-order decision. What are marketers doing to encourage the second-order strategy that benefits them?  How are their packaging and website encouraging consumers to simply use habit and replenishment as their decision strategy? If you are the new brand or a price brand, how are you DISCOURAGING people from doing that and encouraging shoppers to be more explorative?</p>
<p><strong>What type of second-order decision do you want people to use?</strong> I imagine that AT&amp;T and iPhone do not want people to have a high-effort second-order decision strategy.  They want people to just go to the AT&amp;T store and get the leading smart phone (iPhone).  Verizon and Motorola Droid should want people to get curious and to engage in much more information search; a highly engaged second-order decision approach.  In other words, the marketing battle needs to be fought on shaping people’s strategies for deciding and targeting those who have the preferred second-order decision strategy.</p>
<p>One way to get people to engage in a more evolved second-order decision process starts with the realization that it is a coping mechanism when people perceive many available choices.  This idea turns the Schwartz Paradox of Choice concept on its head.  Choice is NOT bad; people want choice to reflect their individuality (that’s why there is a long-tail of choices.) However, when there is a lot of choice, people cope by employing heuristics and second-order decisions to simplify the first-order decision.  Hence, more PERCEIVED choice leads to involved pre-planning. That is what iPhone COMPETITORS should want; get people to see the choices out there.  On the other hand,Apple should want to convince people there is really only one choice.  The battle is waged over the second-order decision strategy.</p>
<p>How can Apple (or any market leader) take a marketplace where there are many choices and make it one with few perceived options? Own the one thing that people should really care about. Taversky pioneered the concept of “elimination by aspects”; all items that don’t possess a certain desired feature are immediately put out of consideration. Dr.  Gerd Gigerenzer has documented many simplifying heuristics that people use, including “take the best” which describes an approach of focusing first on the attribute that is both the most important AND that differentiates the choices. We become blind to other choices.  That’s why Schwartz’ Paradox of Choice is misleading for marketers. </p>
<p><strong>How do we recognize?</strong> The final point I want to make today is the importance of understanding how we recognize things.  When the second-order decision carries the entire load, the planned purchase becomes a foregone conclusion.  Then, the retailer and manufacturer challenge shifts from influencing decisions to influencing recognition.  Gregory Bern, in his book “Iconoclast” talks about perception as a predictive system, where low level visual stimuli are interpreted via retained images and concepts. What cues will best connect your brand to this “predictive system” that people use to recognize things?</p>
<p>Behavioral economics has given us a new path to marketing opportunity.  Let’s study how people decide.</p>
<p><em>This is the second of two posts on applying behavioral economics to marketing issues.  <a href="http://blog.joelrubinson.net/2010/04/what-marketing-research-needs-to-learn-from-behavioral-economics/">The first posting is here</a>.</em></p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2010/04/marketing-insights-into-how-we-decide/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Fifteen issues Marketing was not discussing 15 years ago</title>
		<link>http://blog.joelrubinson.net/2010/03/fifteen-issues-marketing-was-not-discussing-15-years-ago/</link>
		<comments>http://blog.joelrubinson.net/2010/03/fifteen-issues-marketing-was-not-discussing-15-years-ago/#comments</comments>
		<pubDate>Sat, 27 Mar 2010 15:58:51 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[research transformation]]></category>
		<category><![CDATA[advertising]]></category>
		<category><![CDATA[ARF]]></category>
		<category><![CDATA[blogosphere]]></category>
		<category><![CDATA[branding]]></category>
		<category><![CDATA[data quality]]></category>
		<category><![CDATA[listening]]></category>
		<category><![CDATA[market research]]></category>
		<category><![CDATA[media]]></category>
		<category><![CDATA[shopper marketing]]></category>
		<category><![CDATA[social media]]></category>
		<category><![CDATA[storytelling]]></category>

		<guid isPermaLink="false">http://blog.joelrubinson.net/?p=232</guid>
		<description><![CDATA[Marketers must use new approaches and adopt a new corporate culture to become fast-learning organizations, or they will find their opportunities in the new normal defined by a future that is not of their own making.]]></description>
			<content:encoded><![CDATA[<p>Why did The ARF call <a href="http://www.thearf.org/assets/rethink-10">this year’s conference </a>succeeding in the new normal? How different is this year’s industry agenda from prior years or are we talking about the same stuff? The ARF annual conference agendas can be thought of as a chronicler of what the pressing issues are to the marketing and media communities. Because we keep all of our old brochures, I was able to look at the 1995 program. Here is a list of fifteen critical topics today that the industry wasn’t talking about at the ARF conference 15 years ago.</p>
<p>1. Mobile. Not mentioned in 1995 because it wasn’t thought of as an advertising or entertainment medium. Now mobile is at the top of everyone’s list to understand and measure better.</p>
<p>2. Set top box data. A compelling opportunity to get the granularity needed for media properties on the long-tail</p>
<p>3. Social media. Nuff said</p>
<p>4. The human. In 1995, we were focused on the consumer. As Stan Stanunathan from Coca-Cola says, when you focus on consumers you get incremental ideas. When you focus on humans you get breakthroughs.</p>
<p>5. Listening. Not a term the research community was using. Today it is central to generating future-focused insights and there were numerous presentations that leveraged the concept of listening.</p>
<p>6. Insights. In the 1995 brochure the word “insights” appeared only 4 times while the word “research” appeared 179 times. In 1995, we were still focused on the activities and craft of research.</p>
<p>7. Storytelling. This was the agency domain and only recently became a part of research impact</p>
<p>8. Sub-conscious mind. Especially on the biometrics panel, the idea that certain feelings, reactions, etc. are simply not accessible via the conscious mind. How do people make decisions? The model of the rational consumer has been forever overthrown.</p>
<p>9. Shopper. Shopper insights and shopper marketing are important parts of driving brand growth. They weren’t talked about at an advertising research event 15 years ago.</p>
<p>10. Long-tail. Amazon was just being founded in 1995 and before that, physical stores had limits to the choice they could offer. Unlimited choice via online retailers and media has created a level of market fragmentation never before seen.</p>
<p>11. Online research data quality. Online research didn’t really exist in 1995. Online research is such a dominant mode that the quality of the data must be beyond question.</p>
<p>12. We research. In 1995, each respondent was still a separate entity and not encouraged or even allowed to talk with anyone else. Now, firms are attempting to capture the dynamics of social interaction on individual choice in both quantitative research and communities.</p>
<p>13. Online and mobile video. Barely touched on in 1995 but now is a major force that every TV network needs to integrate into a 360 experience with their media properties. At first thought to be a threat to TV, now online and mobile video are thought to actually enhance engagement with the media property and increase TV viewing.</p>
<p>14. Multicultural is the new mainstream. We WERE talking in 1995 about how to conduct valid research among Hispanics but now it is mission critical. Non-Hispanic whites will be the minority in the US in 30 years and this has already happened in a number of major markets.</p>
<p>15. New business giants have emerged since 1995 that have changed the way people live their lives. The list includes: Google, Facebook, Twitter, My Space, LinkedIn, Flickr, Apple iTunes/iPhone/iPad/stores, Hulu, Youtube, Foursquare, Huffington Post, Techcrunch, Zappos, Fox News, Skype, Wikipedia, Firefox, DirecTV, Tivo, XM radio, NetFlix, Pandora.</p>
<p>Our lives are forever changed and are forever changing…truly there is a constantly changing new normal where the past is less and less predictive of the future. Marketers must use new approaches and adopt a new corporate culture to become fast-learning organizations, or they will find their opportunities in the new normal defined by a future that is not of their own making. Please take a minute to look at the video the ARF prepared, with the help of <a href="http://thinktopia.com/">Thinktopia</a>, entitled, “Inspiring Better Brands”.<br />
<object classid="clsid:d27cdb6e-ae6d-11cf-96b8-444553540000" width="480" height="385" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=6,0,40,0"><param name="allowFullScreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="src" value="http://www.youtube.com/v/BYfbjZmk2VQ&amp;hl=en_US&amp;fs=1&amp;" /><param name="allowfullscreen" value="true" /><embed type="application/x-shockwave-flash" width="480" height="385" src="http://www.youtube.com/v/BYfbjZmk2VQ&amp;hl=en_US&amp;fs=1&amp;" allowfullscreen="true" allowscriptaccess="always"></embed></object></p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2010/03/fifteen-issues-marketing-was-not-discussing-15-years-ago/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>How do online and RDD phone research compare? Latest findings&#8230;</title>
		<link>http://blog.joelrubinson.net/2009/09/how-do-online-and-rdd-phone-research-compare-latest-findings/</link>
		<comments>http://blog.joelrubinson.net/2009/09/how-do-online-and-rdd-phone-research-compare-latest-findings/#comments</comments>
		<pubDate>Thu, 10 Sep 2009 16:35:51 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[ARF]]></category>
		<category><![CDATA[data quality]]></category>
		<category><![CDATA[market research]]></category>

		<guid isPermaLink="false">http://blog.joelrubinson.net/?p=189</guid>
		<description><![CDATA[Recent evidence from over 100,000 interviews in a tightly controlled experiment proves online research, using best practices, can produce results that equally or more accurate vs. RDD phone interviewing on a series of benchmarking questions and demographics. ]]></description>
			<content:encoded><![CDATA[<p>The million dollar ARF Foundations of Quality study conducted in Oct/Nov 2008 involved over 100,000 interviews across 17 different online research panel providers, 1,000 RDD telephone interviews and 1,500 interviews conducted via mail panels.</p>
<p>As the ARF continues to release results, we want to share more insight on that important question here.</p>
<p>As can be seen in the two tables below, there is no clear pattern of RDD providing the more accurate answer vs. the average result from internet panel research on a series of benchmarking questions and demographics.  The biggest failures of RDD are in age of respondents and cell phone usage probably due to an increasing percentage (20% currently) of people in the US only having mobile phones and not having landlines.</p>
<table  border="1" cellspacing="0" cellpadding="2" width="560" >
<tbody>
<tr>
<td colspan="2" valign="top"><strong> </strong></td>
<td colspan="3" valign="top"><strong>Foundations of Quality </strong>(Oct–Nov ‘08) <strong><br />
    Raw</strong> (Un-projected)</td>
</tr>
<tr>
<td width="169" valign="top"><strong>Variable</strong></td>
<td width="132" valign="top"><strong>Us Census</strong><strong>Targets</strong></td>
<td width="145" valign="top"><strong>Online (17 panels)</strong></td>
<td width="42" valign="top"><strong>Mail</strong></td>
<td width="60" valign="top"><strong>Phone</strong></td>
</tr>
<tr>
<td valign="top"><strong>Gender</strong></td>
<td valign="top">&nbsp;</td>
<td valign="top">&nbsp;</td>
<td valign="top">&nbsp;</td>
<td valign="top">&nbsp;</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Male </td>
<td valign="top">49%</td>
<td valign="top">48%</td>
<td valign="top">44%</td>
<td valign="top">36%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Female</td>
<td valign="top">51%</td>
<td valign="top">52%</td>
<td valign="top">56%</td>
<td valign="top">64%</td>
</tr>
<tr>
<td valign="top"><strong>Education</strong></td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;HS or less</td>
<td valign="top">47%</td>
<td valign="top">24%</td>
<td valign="top">27%</td>
<td valign="top">29%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Some College</td>
<td valign="top">27%</td>
<td valign="top">43%</td>
<td valign="top">35%</td>
<td valign="top">35%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;4 year College +</td>
<td valign="top">26%</td>
<td valign="top">33%</td>
<td valign="top">34%</td>
<td valign="top">36%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;No response</td>
<td valign="top">&nbsp; </td>
<td valign="top">&#8212;</td>
<td valign="top">4%</td>
<td valign="top">&#8212;</td>
</tr>
<tr>
<td valign="top"><strong>Income</strong></td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Under $50K</td>
<td valign="top">43%</td>
<td valign="top">50%</td>
<td valign="top">35%</td>
<td valign="top">40%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;$50K – 99K</td>
<td valign="top">33%</td>
<td valign="top">33%</td>
<td valign="top">32%</td>
<td valign="top">24%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;$100K</td>
<td valign="top">24%</td>
<td valign="top">12%</td>
<td valign="top">18%</td>
<td valign="top">14%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Prefer not to   answer</td>
<td valign="top">&nbsp; </td>
<td valign="top">5%</td>
<td valign="top">12%</td>
<td valign="top">14%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;No response</td>
<td valign="top">&nbsp; </td>
<td valign="top">&#8211;</td>
<td valign="top">3%</td>
<td valign="top">8%</td>
</tr>
<tr>
<td valign="top"><strong>Race</strong></td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;White</td>
<td valign="top">84%</td>
<td valign="top">87%</td>
<td valign="top">81%</td>
<td valign="top">85%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Non-White</td>
<td valign="top">16%</td>
<td valign="top">12%</td>
<td valign="top">17%</td>
<td valign="top">10%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Prefer not to   answer&nbsp;&nbsp;</td>
<td valign="top">&nbsp; </td>
<td valign="top">1%</td>
<td valign="top">2%</td>
<td valign="top">5%</td>
</tr>
<tr>
<td valign="top"><strong>Marital Status</strong></td>
<td valign="top">NA</td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
<td valign="top">&nbsp; </td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Married</td>
<td valign="top">&nbsp; </td>
<td valign="top">57%</td>
<td valign="top">70%</td>
<td valign="top">58%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Not Married</td>
<td valign="top">&nbsp; </td>
<td valign="top">43%</td>
<td valign="top">28%</td>
<td valign="top">41%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;No Response</td>
<td valign="top">&nbsp; </td>
<td valign="top">&#8212;</td>
<td valign="top">2%</td>
<td valign="top">1%</td>
</tr>
<tr>
<td valign="top"><strong>Age (mean)</strong></td>
<td valign="top">45</td>
<td valign="top">45.7</td>
<td valign="top">46.6</td>
<td valign="top">54.1</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;18-29</td>
<td valign="top">22%</td>
<td valign="top">18%</td>
<td valign="top">12%</td>
<td valign="top">9%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;30-39</td>
<td valign="top">18%</td>
<td valign="top">20%</td>
<td valign="top">20%</td>
<td valign="top">11%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;40-49</td>
<td valign="top">20%</td>
<td valign="top">20%</td>
<td valign="top">20%</td>
<td valign="top">21%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;50-64</td>
<td valign="top">24%</td>
<td valign="top">26%</td>
<td valign="top">26%</td>
<td valign="top">32%</td>
</tr>
<tr>
<td valign="top">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;65+</td>
<td valign="top">16%</td>
<td valign="top">16%</td>
<td valign="top">22%</td>
<td valign="top">27%</td>
</tr>
</tbody>
</table>
<table style="margin-top: 20px;" border="1" cellspacing="0" cellpadding="2" width="560" >
<tbody>
<tr>
<td colspan="2" valign="top"><strong> </strong></td>
<td colspan="3" valign="top"><strong>Foundations   of Quality</strong> (Oct–Nov &#8216;08)<strong><br />
&#8220;Best Practice&#8221; Weighting</strong></td>
</tr>
<tr>
<td width="207" valign="bottom"><strong>Variable</strong></td>
<td width="114" valign="bottom"><strong>Available   Benchmark</strong></td>
<td width="134" valign="bottom"><strong>Online   (17 panels)</strong></td>
<td width="38" valign="bottom"><strong>Mail</strong></td>
<td width="55" valign="bottom"><strong>Phone</strong></td>
</tr>
<tr>
<td valign="bottom"><strong>Own   Home</strong></td>
<td>68%</td>
<td>68%</td>
<td>76%</td>
<td>79%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>Census/AFF</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Ever   Smoked</strong></td>
<td>41%</td>
<td>51%</td>
<td>43%</td>
<td>46%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Now   Smoke</strong></td>
<td>21%</td>
<td>26%</td>
<td>21%</td>
<td>21%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Residential   Phone</strong></td>
<td>80%</td>
<td>84%</td>
<td>84%</td>
<td>100%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>Own   Cell Phone</strong></td>
<td>79%</td>
<td>89%</td>
<td>88%</td>
<td>79%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
<tr>
<td valign="bottom"><strong>%   Calls Received on Cell Phone</strong></td>
<td>41%</td>
<td>39%</td>
<td>39%</td>
<td>26%</td>
</tr>
<tr>
<td valign="bottom"><strong> </strong></td>
<td><strong>CDC/NHIS</strong></td>
<td>&nbsp; </td>
<td>&nbsp; </td>
<td>&nbsp; </td>
</tr>
</tbody>
</table>
<p>While a research supplier can weight data (also called “post-stratification”), the demographic imbalances from RDD are problematic. The more skewed the sample is, the more extreme the weights, the lower the “RIM efficiency”.  This is an important statistic as it tells you the effective sample size.  For example, an ending sample of 1,000 and a RIM efficiency statistic of 40% implies that your sample has the variability of a sample of 400.
<p>Clearly all modes have their challenges and require their own custom-tailored best practices to produce trustworthy information.  Even in the world of political polling, RDD interviewing methods can produce very different results and might not be as accurate as well-designed online research.  Professor Costas Panagopoulos from Fordham’s Political Science Dept analyzed the accuracy of 23 presidential polls regarding the 2008 presidential election.  While nearly all polls use RDD telephone methods, the one poll I recognize as an online poll actually finished third in accuracy (ahead of 20 or so RDD-based polls).  Also, 17 of 23 polls OVERESTIMATED Obama’s margin of victory, indicating a clear bias from RDD polling.  Interestingly, some of the best known polls (e.g. from the original national networks and Gallup finished at the bottom of the list.</p>
<p>Recently an old 2004 study that also compares online to RDD research managed out of Stanford University has resurfaced with some re-analysis of the 5 year old dataset.  Due to the rapid rise of cell-phone only individuals and the apparent failure to employ what would be considered best practice today regarding pre-stratification of online samples, this study is of limited relevance today. <a href="http://www.pollster.com/blogs/doug_rivers.php">(See pollster.com.) </a></p>
<p>Our evidence from Foundations of Quality is that online research can produce comparable, consistent, and accurate data if proper practices are implemented.  If not, for example, if we do not control for sample source, a project can yield data that are not useful.  <a href="http://www.thearf.org/assets/online-research-quality-council">On Sept 29<sup>th</sup>, the ARF will share</a> a process we have co-created with industry leadership that will allow buyer and seller to work collaboratively to produce online research that can be used with confidence to inform marketing decision making.  This meeting is open to all, including the press.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2009/09/how-do-online-and-rdd-phone-research-compare-latest-findings/feed/</wfw:commentRss>
		<slash:comments>10</slash:comments>
		</item>
		<item>
		<title>The commitment to Storytelling at Levi, Strauss</title>
		<link>http://blog.joelrubinson.net/2009/06/the-commitment-to-storytelling-at-levi-strauss/</link>
		<comments>http://blog.joelrubinson.net/2009/06/the-commitment-to-storytelling-at-levi-strauss/#comments</comments>
		<pubDate>Mon, 01 Jun 2009 12:48:12 +0000</pubDate>
		<dc:creator>Joel Rubinson</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[research transformation]]></category>
		<category><![CDATA[conversation]]></category>
		<category><![CDATA[innovation]]></category>
		<category><![CDATA[learning]]></category>
		<category><![CDATA[Levi]]></category>
		<category><![CDATA[Levi Strauss]]></category>
		<category><![CDATA[listening]]></category>
		<category><![CDATA[market research]]></category>
		<category><![CDATA[storytelling]]></category>

		<guid isPermaLink="false">http://rubinson.wordpress.com/?p=139</guid>
		<description><![CDATA[Here is an interview with Michael Perman, Senior Director of Consumer Insights, Levi Strauss &#38; Co.  who has trained over 7,000 on storytelling and who is conducting, with Pat Hanlon, the ARF Workshop, “Stories Inspire” on June 22nd in NY.  The interview with Pat Hanlon can be found here.
Joel: Michael, you are a [...]]]></description>
			<content:encoded><![CDATA[<p><em>Here is an interview with Michael Perman, Senior Director of Consumer Insights, Levi Strauss &amp; Co.  who has trained over 7,000 on storytelling and who is conducting, with Pat Hanlon, <a href="http://thearf.org/assets/arf-university">the ARF Workshop, “Stories Inspire” on June 22nd in NY</a>.  The interview with <a href="http://rubinson.wordpress.com/2009/05/20/cracking-the-code-creating-great-brands/">Pat Hanlon can be found here</a>.</em><br />
Joel: Michael, you are a huge proponent of storytelling to convey insights, having said that “stories inspire”.  What is your best story that shows this? A story about a story, so to speak…<br />
Michael Perman: I arrived in Willamette Valley, Oregon in the grey days of winter 1986, having been sent there from &#8220;headquarters&#8221; to be marketing director for a failing but sizeable beef jerky company.  The team there was mired in the past and sales were languishing.  Analysis of the data yielded no insights, other than small, local competitors were gaining on us&#8230;and that was a clue.  I spent about three months riding in trucks with small jobbers who sold candy, tobacco and jerky.  What an interesting aroma.  I met the owners of small convenience stores in small farm and lumber towns. I also met the people who shopped in those stores. About two months into the journey we learned about Hershey&#8217;s selling big and thick chocolate bars that provided better value to consumers.  Those big sizes were doing really well.  The insight was that mobile consumers&#8217; appetites for larger sized snacks were growing.  So, we created a brand called &#8220;Long Haul&#8221; that made giant sized snacks for people on the go.  We designed a counter display that looked like a truck and developed a few TV ads.  Sales soared and we ended up selling the company for a nice gain.  I fell in love with research.</p>
<p>Joel: Can stories be used to convey quantitative research findings too?<br />
Michael Perman: Yes, but it&#8217;s a matter of focusing on a small number of facts that are truly meaningful.  Maybe even on specific metric about consumption or equity.  Too many reports try to cover too much ground and people lose sight of the big ideas.  Also, facts sometimes need to be validated with human connections&#8230;not always the other way around.</p>
<p>Joel: Can you describe the training you do at Levi Strauss and how it impacts the organization?<br />
Michael Perman: We&#8217;ve trained more than 7,000 employees around the world on developing innovation from insights.  We&#8217;ve taught them how to observe and listen to consumers, how to tell stories about their experiences and how to synthesize cogent themes.  Empathy is a company value.  That ethos helps us get grounded in the reality of our consumers’ lives.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.joelrubinson.net/2009/06/the-commitment-to-storytelling-at-levi-strauss/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
	</channel>
</rss>

