Stop crawler spamming

It is great when search engines frequently visit your site and index your content at most of the times. But sometimes these crawlers are really bad and may break your site down by sending thousands of request every second. Is there anyway we can work with search engines better? Answer is yes.