ASP.NET的恶意爬网程序阻止程序 [英] Malicious crawler blocker for ASP.NET

问题描述

我刚刚偶然发现不良行为-一个承诺检测到PHP的PHP插件通过阻止垃圾邮件和恶意爬网程序完全访问该网站来实现.

I have just stumbled upon Bad Behavior - a plugin for PHP that promises to detect spam and malicious crawlers by preventing them from accessing the site at all.

ASP.NET和ASP.NET MVC是否存在类似的东西?

Does something similar exist for ASP.NET and ASP.NET MVC?

我有兴趣完全阻止对该网站的访问，而不是在发布垃圾邮件后检测它.

I am interested in blocking access to the site altogether, not in detecting spam after it was posted.

我对检测站点访问模式的解决方案特别感兴趣-这些将防止屏幕从整体上刮擦站点，或者至少使对犯罪者而言这是一个非常缓慢的过程，因为机器人必须采取行动作为普通用户的点击频率和在点击中发现的模式(按深度优先顺序访问的100个链接清楚地表明有人在爬网).

I am interested specifically in solutions that will detect access patterns to the site - these would prevent screen scraping the site as a whole, or at least make it a very slow process for the offender because the bot would have to act as a regular user in frequency of his clicks and in patterns found in the clicks (100 links visited in depth-first succession are a clear indication that someone is crawling the site).

所谓的恶意爬虫，主要是指正在构建其他网站副本的机器人，但又有试图在该网站上找到一些可提交表格并提交废话的垃圾邮件机器人.

By malicious crawler I mean primarily bots that are building duplicate copies of other sites but also spambots that are trying to locate some submittable forms on the site and submit their crap.

推荐答案

The NoBot control in the ASP.NET AJAX Toolkit might help, if I understand you correctly. From the description page:

NoBot是一种控件，它试图提供类似于CAPTCHA的僵尸程序/垃圾邮件防护，而无需任何用户交互.这种方法比需要实际人工干预的实现更容易绕开，但是NoBot具有完全不可见的优点.

NoBot is a control that attempts to provide CAPTCHA-like bot/spam prevention without requiring any user interaction. This approach is easier to bypass than an implementation that requires actual human intervention, but NoBot has the benefit of being completely invisible.

我自己还没有使用过它，所以我不能说它对复杂的机器人的有效性，但是听起来这恰恰是您在说的.它具有非常简单的好处.本质上，您可以将其添加到母版页中.

I haven't used this one myself, so I can't speak to its effectiveness against sophisticated bots, but it sounds like it's meant to be exactly what you're talking about. It has the benefit of being very simple; essentially a drop-in you can add to a master page.

这篇关于ASP.NET的恶意爬网程序阻止程序的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！