<?xml version="1.0" encoding="utf-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	>
<channel>
	<title>Comments on: Stats You Can Trust</title>
	<atom:link href="http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/feed/" rel="self" type="application/rss+xml" />
	<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/</link>
	<description>Michael W. Geoghegan's Weblog</description>
	<pubDate>Fri, 29 Aug 2008 13:04:11 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.5.1</generator>
		<item>
		<title>By: 3000+ Subscribers at MWGblog</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-51141</link>
		<dc:creator>3000+ Subscribers at MWGblog</dc:creator>
		<pubDate>Thu, 10 May 2007 00:41:50 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-51141</guid>
		<description>[...] Well it seems this humble blog just crested 3000 subscribers. However, we have been here before. [...]</description>
		<content:encoded><![CDATA[<p>[...] Well it seems this humble blog just crested 3000 subscribers. However, we have been here before. [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Todd Cochrane</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36591</link>
		<dc:creator>Todd Cochrane</dc:creator>
		<pubDate>Thu, 15 Mar 2007 23:25:13 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36591</guid>
		<description>I look at podcast stats daily and I can tell you one thing most podcasters have no idea what their real numbers are. We have been working hard on stats for a long time and are beta testing and verfying data in a new stats engine we will be releasing to those that are part of our family of podcast communities. 

When I process 600 plus shows for advertising deals I have to know within a couple of percentage points what the numbers are for those 600 shows. Luckily I have been doing this long enough now and with the auxiliary survey and repeat listener data that we track we can tell where a podcasters audience is headed.

Thus when I present sponsorships and I tell the advertisers that we are going to be able to get them 2.5 million listner exposures that it really is 2.5 million listener exposures. The total downloads may be in excess of that but by combining data from multiple sources you are able to build a picture that is very accurate of what the active audience size is for a show.

This is one of the reasons out advertisers continue to expand and renew contracts month after month is because we are delivering exceptional ROI. 

I know Michael hates the CPM model but most media buyers are still living in that world and this why we have to convert them one at a time. Michaels model of flat sponsorships is great but it is one that is not easily replicated across hundreeds of shows.

Podcasters just need to realize that the RSS Feedburner number is not what your going to get paid on in any advertising campaign nor should it be used as a indication of what ones audience size is. 

Audience participation is another metric that factors into the advertising marketability, and while we have been incorporating that data we have a pretty good picture before a single ad is run on what performance a specific show is going to have and are able to assign a performance value to the podcast.</description>
		<content:encoded><![CDATA[<p>I look at podcast stats daily and I can tell you one thing most podcasters have no idea what their real numbers are. We have been working hard on stats for a long time and are beta testing and verfying data in a new stats engine we will be releasing to those that are part of our family of podcast communities. </p>
<p>When I process 600 plus shows for advertising deals I have to know within a couple of percentage points what the numbers are for those 600 shows. Luckily I have been doing this long enough now and with the auxiliary survey and repeat listener data that we track we can tell where a podcasters audience is headed.</p>
<p>Thus when I present sponsorships and I tell the advertisers that we are going to be able to get them 2.5 million listner exposures that it really is 2.5 million listener exposures. The total downloads may be in excess of that but by combining data from multiple sources you are able to build a picture that is very accurate of what the active audience size is for a show.</p>
<p>This is one of the reasons out advertisers continue to expand and renew contracts month after month is because we are delivering exceptional ROI. </p>
<p>I know Michael hates the CPM model but most media buyers are still living in that world and this why we have to convert them one at a time. Michaels model of flat sponsorships is great but it is one that is not easily replicated across hundreeds of shows.</p>
<p>Podcasters just need to realize that the RSS Feedburner number is not what your going to get paid on in any advertising campaign nor should it be used as a indication of what ones audience size is. </p>
<p>Audience participation is another metric that factors into the advertising marketability, and while we have been incorporating that data we have a pretty good picture before a single ad is run on what performance a specific show is going to have and are able to assign a performance value to the podcast.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Rick Klau</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36567</link>
		<dc:creator>Rick Klau</dc:creator>
		<pubDate>Thu, 15 Mar 2007 18:50:29 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36567</guid>
		<description>Scott -

The ABC is measuring something fundamentally different, and is constrained by its medium (print) versus what we as an industry can look at online. I can't speak to ABC's methodology in any detail, but from what you lay out above, you're describing a sample poll, coupled with numbers provided by the publishers themsleves, and some educated guesses made about pass-along readership.

Those inferences are required because there's no way to actually measure how many times a magazine was opened.

Compare to podcasts (and, to broaden the discussion a bit, feeds). I wrote a lengthy post over at our blog a couple weeks ago about audience engagement:

http://blogs.feedburner.com/feedburner/archives/2007/02/feedburners_view_of_the_feed_m.php

Bottom line, we *can* measure resyndication, downloads, views, clicks, etc. Focusing on subscriber numbers alone - especially when those numbers may reflect inactive audience members who are not in fact reading/listening - without taking into account other metrics (not guesses, but metrics) seems to me to miss the larger picture. I think advertisers are acutely interested in this when looking at podcasts, and we'd like to think we're helping podcasters out by getting a complete picture of their audience.

--Rick</description>
		<content:encoded><![CDATA[<p>Scott -</p>
<p>The ABC is measuring something fundamentally different, and is constrained by its medium (print) versus what we as an industry can look at online. I can&#8217;t speak to ABC&#8217;s methodology in any detail, but from what you lay out above, you&#8217;re describing a sample poll, coupled with numbers provided by the publishers themsleves, and some educated guesses made about pass-along readership.</p>
<p>Those inferences are required because there&#8217;s no way to actually measure how many times a magazine was opened.</p>
<p>Compare to podcasts (and, to broaden the discussion a bit, feeds). I wrote a lengthy post over at our blog a couple weeks ago about audience engagement:</p>
<p><a href="http://blogs.feedburner.com/feedburner/archives/2007/02/feedburners_view_of_the_feed_m.php" rel="nofollow">http://blogs.feedburner.com/feedburner/archives/2007/02/feedburners_view_of_the_feed_m.php</a></p>
<p>Bottom line, we *can* measure resyndication, downloads, views, clicks, etc. Focusing on subscriber numbers alone - especially when those numbers may reflect inactive audience members who are not in fact reading/listening - without taking into account other metrics (not guesses, but metrics) seems to me to miss the larger picture. I think advertisers are acutely interested in this when looking at podcasts, and we&#8217;d like to think we&#8217;re helping podcasters out by getting a complete picture of their audience.</p>
<p>&#8211;Rick</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Scott Bourne</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36566</link>
		<dc:creator>Scott Bourne</dc:creator>
		<pubDate>Thu, 15 Mar 2007 18:45:25 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36566</guid>
		<description>Several folks left comments above that indicate subscriber counts are not something advertisers will be interested in. 

If that were true, there'd be little chance that the Audit Bureau of Circulation would be in business. ABC measures magazine distribution by auditing subscriber lists and measuring rack sales. On this basis alone, ad agencies buy millions of dollars worth of magazine ads each month. There is no stat offered to prove each magazine reader saw or read each ad, so why would podcasters want to allow that higher standard to be applied to them? 

In my opinion, that's a big mistake, and if that mistake is made often enough, it will seriously devalue our audience.

I realize the discussion is branching out a bit here, but I believe any discussion that involves podcasters allowing themselves to be held to higher standards than broadcast or print is a mistake.</description>
		<content:encoded><![CDATA[<p>Several folks left comments above that indicate subscriber counts are not something advertisers will be interested in. </p>
<p>If that were true, there&#8217;d be little chance that the Audit Bureau of Circulation would be in business. ABC measures magazine distribution by auditing subscriber lists and measuring rack sales. On this basis alone, ad agencies buy millions of dollars worth of magazine ads each month. There is no stat offered to prove each magazine reader saw or read each ad, so why would podcasters want to allow that higher standard to be applied to them? </p>
<p>In my opinion, that&#8217;s a big mistake, and if that mistake is made often enough, it will seriously devalue our audience.</p>
<p>I realize the discussion is branching out a bit here, but I believe any discussion that involves podcasters allowing themselves to be held to higher standards than broadcast or print is a mistake.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Brian Walsh</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36561</link>
		<dc:creator>Brian Walsh</dc:creator>
		<pubDate>Thu, 15 Mar 2007 17:36:54 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36561</guid>
		<description>Michael...

I have always looked @ RSS stats to be an estimation of usage for podcasts, but not a good measure of audience to report on.  The actual usage will be affected by syndication, plays through the web, etc.  Even saying the number was accurate, the actual plays/downloads can be skewed from something as simple as the default iTunes settings only downloading the newest show; if their iTunes has not been open for x days, it may skip shows.

I still believe that analytics based on, at a minimum, downloads or, better yet, actual usage are a better measure for reporting.</description>
		<content:encoded><![CDATA[<p>Michael&#8230;</p>
<p>I have always looked @ RSS stats to be an estimation of usage for podcasts, but not a good measure of audience to report on.  The actual usage will be affected by syndication, plays through the web, etc.  Even saying the number was accurate, the actual plays/downloads can be skewed from something as simple as the default iTunes settings only downloading the newest show; if their iTunes has not been open for x days, it may skip shows.</p>
<p>I still believe that analytics based on, at a minimum, downloads or, better yet, actual usage are a better measure for reporting.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Rick Klau</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36553</link>
		<dc:creator>Rick Klau</dc:creator>
		<pubDate>Thu, 15 Mar 2007 15:46:32 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36553</guid>
		<description>Michael -

I'm at a conference today so apologies for a quick response. But after a quick look at your stats, it appears that the change is a direct result of the number being reported to us by one of the web-based aggregators. I don't want to reveal your private stats info in a comment, but would be happy to (if you want me to) or we can chat by e-mail. If you're interested in seeing what I'm seeing, compare the numbers on your subscriber number for one day vs. 'all time' and look at the gaps in the user agents. Now - this may be a mistake by that aggregator - in which case we can certainly contact them to find out why their reported number changed dramatically. For more on how we work with web-based services to determine subscriber numbers, see this post:

http://blogs.feedburner.com/feedburner/archives/2007/01/whats_up_with_that_vol_1.php

On the advertising side: I don't really think subscriber numbers matter much in advertising. Since the subscriber number is an indication of how many people have subscribed - but not how many have actually *consumed* content - it's not a good proxy when talking to advertisers. Downloads, item views, clicks - all would be much better barometers for how large your audience is.

I'd love to continue this conversation - I think it's an important one and it's certainly something we think a lot about at FeedBurner. Thanks for raising the point.

--Rick Klau
VP, Publisher Services
rickk@feedburner.com
AIM/Y!/Skype: RickKlau
312.756.0022 x2012</description>
		<content:encoded><![CDATA[<p>Michael -</p>
<p>I&#8217;m at a conference today so apologies for a quick response. But after a quick look at your stats, it appears that the change is a direct result of the number being reported to us by one of the web-based aggregators. I don&#8217;t want to reveal your private stats info in a comment, but would be happy to (if you want me to) or we can chat by e-mail. If you&#8217;re interested in seeing what I&#8217;m seeing, compare the numbers on your subscriber number for one day vs. &#8216;all time&#8217; and look at the gaps in the user agents. Now - this may be a mistake by that aggregator - in which case we can certainly contact them to find out why their reported number changed dramatically. For more on how we work with web-based services to determine subscriber numbers, see this post:</p>
<p><a href="http://blogs.feedburner.com/feedburner/archives/2007/01/whats_up_with_that_vol_1.php" rel="nofollow">http://blogs.feedburner.com/feedburner/archives/2007/01/whats_up_with_that_vol_1.php</a></p>
<p>On the advertising side: I don&#8217;t really think subscriber numbers matter much in advertising. Since the subscriber number is an indication of how many people have subscribed - but not how many have actually *consumed* content - it&#8217;s not a good proxy when talking to advertisers. Downloads, item views, clicks - all would be much better barometers for how large your audience is.</p>
<p>I&#8217;d love to continue this conversation - I think it&#8217;s an important one and it&#8217;s certainly something we think a lot about at FeedBurner. Thanks for raising the point.</p>
<p>&#8211;Rick Klau<br />
VP, Publisher Services<br />
<a href="mailto:rickk@feedburner.com">rickk@feedburner.com</a><br />
AIM/Y!/Skype: RickKlau<br />
312.756.0022 x2012</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Eric Likness</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36552</link>
		<dc:creator>Eric Likness</dc:creator>
		<pubDate>Thu, 15 Mar 2007 15:41:04 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36552</guid>
		<description>Mike,

This is always a sore spot for the podcast for profit community. Adam Curry/Ron Bloom at Podshow.com eschewed the CPM model for 'brand' advertising. I'm not a business owner, never taken marketing, so 'brand' advertising is not a term I'm familiar with at all. But for now they seemed to be keeping the Splenda and Folger's ads running. And the obligatory Go Daddy promo appears on a lot of Podshow properties. So maybe 'brand' advertising is one possible route around the CPM convention used for most advertising. Who knows?

One follow-up to the readership of your blog. I know that TechCrunch follows the uptake of the web-based RSS readers pretty closely. Bloglines was tops, now Google RSS reader seems to have overtaken that spot. Right now in Bloglines using this path to your feed:

 	http://mwgblog.com/feed

Bloglines reports 9 subscriptions. Like you say, there's no sure bet on how many readers there are. And Bloglines may not be the best 'scaling' factor to apply to FeedBurner's stats. So the best estimate (turning on the irony filter here) is you have somehwere between 9 and 2206 subscribers to MWBlog (turn off irony filter). It's unfortunate, especially as you pointed out when you're talking to advertisers. Still no easy answers after almost 3 years of podcasting.</description>
		<content:encoded><![CDATA[<p>Mike,</p>
<p>This is always a sore spot for the podcast for profit community. Adam Curry/Ron Bloom at Podshow.com eschewed the CPM model for &#8216;brand&#8217; advertising. I&#8217;m not a business owner, never taken marketing, so &#8216;brand&#8217; advertising is not a term I&#8217;m familiar with at all. But for now they seemed to be keeping the Splenda and Folger&#8217;s ads running. And the obligatory Go Daddy promo appears on a lot of Podshow properties. So maybe &#8216;brand&#8217; advertising is one possible route around the CPM convention used for most advertising. Who knows?</p>
<p>One follow-up to the readership of your blog. I know that TechCrunch follows the uptake of the web-based RSS readers pretty closely. Bloglines was tops, now Google RSS reader seems to have overtaken that spot. Right now in Bloglines using this path to your feed:</p>
<p> 	<a href="http://mwgblog.com/feed" rel="nofollow">http://mwgblog.com/feed</a></p>
<p>Bloglines reports 9 subscriptions. Like you say, there&#8217;s no sure bet on how many readers there are. And Bloglines may not be the best &#8217;scaling&#8217; factor to apply to FeedBurner&#8217;s stats. So the best estimate (turning on the irony filter here) is you have somehwere between 9 and 2206 subscribers to MWBlog (turn off irony filter). It&#8217;s unfortunate, especially as you pointed out when you&#8217;re talking to advertisers. Still no easy answers after almost 3 years of podcasting.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Podcasting Tricks - Podcasting How-To Site</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36535</link>
		<dc:creator>Podcasting Tricks - Podcasting How-To Site</dc:creator>
		<pubDate>Thu, 15 Mar 2007 11:56:08 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36535</guid>
		<description>[...] Michael Geoghegan from Gigavox has an interesting look at the Feedburner stat controversy. Like many people, his Feedburner numbers changed by about 80% - seemingly overnight. [...]</description>
		<content:encoded><![CDATA[<p>[...] Michael Geoghegan from Gigavox has an interesting look at the Feedburner stat controversy. Like many people, his Feedburner numbers changed by about 80% - seemingly overnight. [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: My Feedvertising Experiment - And Some Numbers &#8230; &#124; Paul Colligan&#8217;s Profitable Podcasting</title>
		<link>http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36515</link>
		<dc:creator>My Feedvertising Experiment - And Some Numbers &#8230; &#124; Paul Colligan&#8217;s Profitable Podcasting</dc:creator>
		<pubDate>Thu, 15 Mar 2007 07:09:57 +0000</pubDate>
		<guid isPermaLink="false">http://mwgblog.com/archives/2007/03/14/stats-you-can-trust/#comment-36515</guid>
		<description>[...] And of course, this requires a simple trust in your Feedburner stats that not everyone has. [...]</description>
		<content:encoded><![CDATA[<p>[...] And of course, this requires a simple trust in your Feedburner stats that not everyone has. [...]</p>
]]></content:encoded>
	</item>
</channel>
</rss>
