Keith Devens .com

It would be nice if there was some sort of browser header the aggregator could send to identify itself instead of using the referrer field. Oh, that's right, there is. It's called User-Agent.

I've covered this before. I feel evil that I'm now using an aggregator that does just this:

Some aggregators have taken things a step further by allowing the user to use any arbitrary URL as the referrer.

Bad.

So I get 48 "referrals" each day from www.hardhathosting.com even though there's not a single link from their site to mine.

Me too! Finally, Jason has a great argument:

Each time I load a page in Internet Explorer, I don't leave a referer for www.microsoft.com/ie in the log files of the site whose page I loaded, so why should any of the RSS readers be different?

Plus, he has an actual reference to the HTTP RFC where they declare these types of abuses to be illegal.

Permalink | 4 Comments | id 3386

22:31 (utc-5)

Comments

Hey, that's me. Sorry about the 48 referrals a day from HardHatHosting.com. I use Syndirella and it updates every hour. I happened to put one of my company's websites in the referral setting. I never thought of the implications of Syndirella hitting your logs all day long. What would you suggest I use instead?

Hey Chris! I'd just put it back to the default, http://www.syndirella.net/. It'd cut down on the proliferation of false referrers.

(First: I'm not really defending the current abuse, it only seems that way) :-) I think the "great" IE example is flawed. RSS readers should be different because they are actually trying to do something different. The whole referer-overloading thing was an attempt to create a more two-way web and give readers a way to "leave a trail". IE doesn't even try to give any feedback about who is reading a resource.

Feel free to post a comment below. Please see my comment policy.

Formatting Rules (No HTML):

**bold**, *italic*, _underlined_, --strikeout--
"text"="url" creates a link, and URLs are auto-highlighted
Blockquote: Like e-mail, begin paragraph with > (greater-than sign)
Lists: begin paragraph with *,-, or + (unordered), or # (ordered)
Code block: ?!code:language=perl|php|sql|javascript|etc.{\n}...{\n}?!/code

RSS feed RSS feed for Keith's Weblog
Atom feed Atom feed for Keith's Weblog
Weblog archive
Recent comments
on 4 posts

Thursday, January 30, 2003

Stick to the user-agent, or RSS readers misuse the referrer header

Comments

Recent comments