在非常大的网站上使用Xenu Link Sleuth？ [英] Use of Xenu Link Sleuth on very large sites?
问题描述
有没有人有运行Xenu Link Sleuth的经验：
http ：//home.snafu.de/tilman/xenulink.html
版本1.2e在非常大的网站上？
我是在我的网站上运行它时出现问题，在我的电脑上，它会在很长一段时间内消耗掉100％的CPU周期（通常没有互联网）活动）。
我已经与该程序的作者保持联系，但这个问题在他的系统上并没有发生。
由于100％的CPU利用率，该程序的价格比它应该慢得多，而且我刚刚终止了
再次尝试该程序。
在4小时内，它已检查了96,146个112,138个链接，但
我知道还有更多要检查的内容。
-
Dave Patton
加拿大协调员，学位合流P roject
http://www.confluence.org dpatton at confluence dot org
我的网站： http://members.shaw.ca/davepatton /
温哥华/惠斯勒 - 2010年冬季奥运会的主持人
Does anyone have any experience running Xenu Link Sleuth:
http://home.snafu.de/tilman/xenulink.html
version 1.2e on very large sites?
I''m having problems running it against our site, in that
on my PC it will, for extended periods of time, consume
100% of the CPU cycles(usually with no internet activity).
I''ve been in touch with the program''s author, but this
problem doesn''t happen on his system.
Because of the 100% CPU utilisation, the program is of
course much slower than it should be, and I just terminated
the program after trying it again.
In 4 hours, it had checked 96,146 of 112,138 links, but
I know there are many more to check.
--
Dave Patton
Canadian Coordinator, the Degree Confluence Project
http://www.confluence.org dpatton at confluence dot org
My website: http://members.shaw.ca/davepatton/
Vancouver/Whistler - host of the 2010 Winter Olympics
推荐答案
文章< Xn * *****************************@24.71.223.159> ，Dave Patton键盘上的无限猴子之一
< dp ***** @ remove-for-nospam.confluence.org>写道：
In article <Xn******************************@24.71.223.159> , one of infinite monkeys
at the keyboard of Dave Patton <dp*****@remove-for-nospam.confluence.org> wrote:
在4个小时内，它检查了112,138个链接中的96,146个，但是我知道还有更多要检查的内容。
In 4 hours, it had checked 96,146 of 112,138 links, but
I know there are many more to check.
96000链接在4小时内每秒接近7个链接，如果它消耗了没有互联网活动的CPU
，那就是所有点击你的
拥有服务器！这似乎意味着一个非常不善行为的机器人。
当然，如果它只是你的服务器被击中那么它就是你的业务的
，但你的问题表明这是一个问题。
你可能会更好地使用像网站代客这样一个表现良好的机器人。
它'即使您配置了一个短的
重新访问网站时间，也会花费更长的时间（根据定义），但系统负载可以忽略不计，即使它在很多时候运行了很多b $ b [1]每秒点击次数（全部到不同的服务器，因此
不要将任何一台服务器暴露在快速点火中。）
[1 ]我不能告诉你很多的上限，它的带宽是有限的。
-
Nick Kew
96000 links in 4 hours is nearly 7 links per second, and if it''s
consuming CPU without internet activity that''s all hits to your
own server! That seems to imply an extremely ill-behaved robot.
Of course if it''s only your server that''s getting hit then it''s
your business, but your question suggests it is a problem.
You''d probably be better off using a well-behaved robot like Site Valet.
It''ll take longer (by definition) even if you configure a short
revisit-site time, but the system load is negligible even when it''s
running at many[1] hits per second (all to different servers so as
not to expose any one server to rapid-fire, of course).
[1] I can''t tell you an upper limit to "many", it''s bandwidth-limited.
--
Nick Kew
Nick Kew写道：
Nick Kew wrote:
这似乎意味着一个极度不行的机器人。
当然，如果它'只有你的服务器被击中然后它就是你的r business，但你的问题表明这是一个问题。
你可能会更好地使用像网站代客这样一个表现良好的机器人。
That seems to imply an extremely ill-behaved robot.
Of course if it''s only your server that''s getting hit then it''s
your business, but your question suggests it is a problem.
You''d probably be better off using a well-behaved robot like Site Valet.
你得到了不恰当的结论，没有任何迹象表明，Xenu不是一个表现良好的机器人。 OP的
描述表明它是OP的本地问题，因为
作者的系统没有表现出这种行为。
我多年来一直在使用Xenu，它不仅表现良好，而且还快速免费（现场代客免费？）
。
-
Spartanicus
You''re jumping to an inappropriate conclusion, there is no indication
that Xenu is anything less that a well behaved robot. The OP''s
description indicates that it is a problem local to the OP as the
author''s system does not exhibit this behaviour.
I''ve been using Xenu for years and it''s not only well behaved, it''s also
lightning fast and free (is Site Valet free?).
--
Spartanicus
在帖子< news：Xn **** **************************@24.71.223.1 59>
戴夫巴顿说：
in post <news:Xn******************************@24.71.223.1 59>
Dave Patton said:
有没有人有任何运行Xenu Link侦探的经验：
http://home.snafu.de/tilman/xenulink.html
版本1.2e在非常大的网站上？
我在遇到问题时遇到了问题我们的网站，在我的电脑上，它会在很长一段时间内消耗100％的CPU周期（通常没有网络活动）。
Does anyone have any experience running Xenu Link Sleuth:
http://home.snafu.de/tilman/xenulink.html
version 1.2e on very large sites?
I''m having problems running it against our site, in that
on my PC it will, for extended periods of time, consume
100% of the CPU cycles(usually with no internet activity).
$ b $我不记得版本（它是几年前），但我曾经查看一个
网站本地由15k +页面组成，内部链接约为300k（没有
外部）。其他一切都必须关闭，大约花了7个小时
来完成。它经常出现没有任何活动，并且
计算机已经崩溃了。它是在备用电脑上所以它并不是真的很重要。
-
brucie
19 / December / 2003 07:01:08 pm kilo
i cant remember the version (it was years ago) but i used to check a
site locally made up of 15k+ pages with about 300k internal links (no
external). everything else had to be shut down and it took about 7 hours
to complete. it often appeared there was no activity and that the
computer had crashed. it was on a spare computer so it didn''t really
matter.
--
brucie
19/December/2003 07:01:08 pm kilo
这篇关于在非常大的网站上使用Xenu Link Sleuth？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
