Catching Unwanted Spiders And Content Scraping Bots In ASP.NET(colincochrane.com)

submitted by ColinCochraneColinCochrane(235) 4 years, 1 month ago

If you have a blog that is even moderately popular then you have likely fallen victim to some form of content scraping. Ever since it became possible to earn money through ads on a website there have been people trying to find ways to cheat the system. The most widespread example of this comes in the form of splogs and similar spam-based websites, which consist only of ads from Google AdSense and duplicated content that is scraped from other sites. In this post I share a method you can use to identify "evil" spiders and content scraping bots that are wasting your website's resources.

add a comment |category: |Views: 14

tags: another

new Add a live kick counter to your blog >> liveImage

You can even customize the image by choosing your own colors, and then clicking the button below to update the preview and the html code:

  • "Kick It" text
  • "Kick It" background
  • kick count text
  • kick count background
  • border

Simply copy and paste this HTML into your blog post.


Users who kicked this story:
Comments:

No comments so far

information Login or create an account to comment on this story