Stop crawler spamming(mypath2us.com)
submitted by
usagene(85) 2 years, 7 months ago
It is great when search engines frequently visit your site and index your content at most of the times. But sometimes these crawlers are really bad and may break your site down by sending thousands of request every second. Is there anyway we can work with search engines better? Answer is yes.
|category: Security
|Views: 4
tags:
Security another
Everyones tags:
Your Tags: