确定一个搜索引擎爬虫 [英] Identifying a Search Engine Crawler

问题描述

我工作的一个网站，通过AJAX加载数据。我也希望，整个网站可通过谷歌和雅虎的搜索引擎抓取。 我想使两个版本的网站... [1]当用户谈到的超级链接应该只是如Gmail（＃'编辑超链接） [2]当履带而来的超链接应正常工作（AJAX模式关闭）

I am working on a website which loads its data via AJAX. I also want that the whole website can be crawled by search engines like google and yahoo. I want to make 2 versions of the site... [1] When a user comes the hyperlinks should work just like GMAIL (#'ed hyperlinks) [2] When a crawler comes the hyperlinks should work normally (AJAX mode off)

我如何确定一个履带??

How can i identify a Crawler??

推荐答案

您不应该present不同形式的网站对用户和履带。如果谷歌发现你这样做，他们可能会减少，因为它的搜索排名。此外，如果你有一个版本是只对履带，它可能会破坏你没有注意到，从而使搜索引擎坏数据。

You should not present a different form of your website to your users and a crawler. If Google discovers you doing that, they may reduce your search ranking because of it. Also, if you have a version that's only for a crawler, it may break without you noticing, thus giving search engines bad data.

我会建议是建立一个版本的网站，不需要AJAX，并有向非Ajax版本的每一页上的显着链接。这也将帮助用户谁可能不喜欢AJAX版本，或谁拥有浏览器，不能够正确地处理它。

What I'd recommend is building a version of your site that doesn't require AJAX, and having prominent links on each page to the non-AJAX version. This will also help users who may not like the AJAX version, or who have browser which aren't capable of handling it properly.

这篇关于确定一个搜索引擎爬虫的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！