ReferrerCop

ReferrerCop parses Apache log files and AWStats data files and removes entries for referring URLs that match a list of known referrer spammers. Logs can be run through ReferrerCop either before or after they're processed by AWStats (or before they're processed by any other log analyzer) to eliminate annoying referrer spam from Web statistics.

Tags Internet Log Analysis Web Software Development Libraries Ruby Modules Systems Administration Utilities
Licenses GPL
Operating Systems OS Independent
Implementation Ruby

Tweet this project Short link

Rss Recent releases

  • Rrelease-mid
  •  03 Mar 2006 01:23
  • Rrelease-after

Changes: The format of blacklists and whitelists has changed slightly. Performance with large lists has been improved. The blacklist update feature is now more reliable.

  • Rrelease-mid
  •  18 Oct 2005 00:09
  • Rrelease-after

Changes: A new command-line option was added to automatically download blacklist updates and a bug in the filtering of AWStats data files was fixed.

  • Rrelease-mid
  •  06 Oct 2005 03:18
  • Rrelease-after

Changes: An in-place filtering mode was added and the parsing of AWStats data files was improved.

  • Rrelease-mid
  •  17 Jun 2005 21:12
  • Rrelease-after

Changes: Filtering performance was improved by over 300%, new command line options were added for extracting URLs from filtered files, and the Ruby API was improved.

Changes: Wildcards and multiple files may now be specified on the command line. Malformed lines in Apache logs are handled gracefully. Several new command-line options were added.

Rss Recent comments

Rcomment-before 10 Jun 2005 07:25 Rcomment-trans suso Rcomment-after

Unbelievable
Nothing against your software, its great that you wrote it. But just a comment about the fact that it had to be written. Its unbelievable that its coming to this. Having to write programs to match advertisements that are being put into webserver log files through referal headers. What is our precious little internet coming too.

Having received some "referer spam" myself, once I realized what it was, I was less inclined to do any business with the refered site. I guess they are counting on less technical people who read their stats to follow the links. Sigh. I digress.

One thing about this though that makes it different from email spam is that you can be pretty sure that you can send a message back to the spammer by putting a long message in the URL that you go to to get to the refered site, like this:

http://www.stupidspammer.com/STOP DOING REFERAL SPAMMING

6c2b08cacb2c32c2901098941927a1d0_thumb

Project Spotlight

jFramework

A PHP framework with simplicity and scalabality in mind.

No-screenshot

Project Spotlight

PyOpenCL

A Python wrapper around the OpenCL library.