使用Nutch抓取Microsoft数据集 [英] use Nutch to crawl Microsoft Dataset

问题描述

大家好，

我是Nutch的新手.我是IR研究小组的成员，并且需要创建一个设置程序，在该设置程序中，我需要使用Nutch来抓取Microsoft的数据集.谷歌搜索了一段时间之后，我没有得到任何教程或帮助.有人可以指导我吗?

我在Ubuntu 11.10和Eclipse 3.7上使用Nutch 1.4.

到现在为止，我可以从与Eclipse集成的Nutch设置中抓取公共网络...

是否有任何教程或维基百科解释了如何实现此目标-或文件系统上保留的任何其他数据集?如果没有，请您帮帮我....
提前谢谢.
干杯!!!!!!

-
Varun

Hey Guys,

I am new to Nutch. I am part of a IR research team & need to create a setup where in I need to crawl Microsoft''s Dataset with Nutch. After googling for a while, I didn''t get any tutorial or help. Can anyone guide me for the same?

I am using Nutch 1.4 on Ubuntu 11.10 & Eclipse 3.7.

Till now I am able to crawl public network from my Nutch setup integrated with Eclipse...

Is there any tutorial or wiki explaining how I can achieve this - or any other dataset kept on File System? If not, can you help me please....
Thanks in advance.
Cheers!!!

-
Varun

推荐答案

那里只有少量文档和教程:

http://nutch.apache.org/wiki.html [

there is just a little bit of documentation and tutorial right there:

http://nutch.apache.org/wiki.html[^]

Also please check the "related Projects" that might give some more input on how to use that stuff.

这篇关于使用Nutch抓取Microsoft数据集的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！