如何从网页中提取文本内容？ [英] How to extract textual contents from a web page?

问题描述

我正在开发一个java应用程序，它可以从不同的网页中获取文本信息并将其汇总成一个页面。例如，假设我在印度时报，印度时报，政治家等不同的网页上有新闻。 。现在我的应用程序应该从这些页面的每一个中提取重要点，并将它们作为单个新闻组合在一起。应用程序基于Web内容挖掘的概念。作为这个领域的初学者，我无法理解我已经通过研究论文解释了噪声去除作为建立这个应用程序的第一步。

I'm developing an application in java which can take textual information from different web pages and will summarize it into one page.For example,suppose I have a news on different web pages like Hindu,Times of India,Statesman,etc.Now my application is supposed to extract important points from each one of these pages and will put them together as a single news.The application is based on concepts of web content mining.As a beginner to this field,I can't understand where to start off.I have gone through research papers which explains noise removal as first step in buiding this application.

所以，如果我给了一个新闻网页，那么第一步是从页面中提取主要新闻，不包括超链接，广告，无用的图像等。我的问题是我该怎么做？请给我一些很好的教程，解释使用Web内容挖掘实现这种应用程序。或者至少给我一些提示如何实现它？

So,if I'm given a news web page the very first step is to extract main news from the page excluding hyperlinks,advertisements,useless images,etc. My question is how can I do this ? Please give me some good tutorials which explains the implementation of such kind of application using web content mining.Or at least give me some hint how to accomplish it ?

推荐答案

您可以使用可读性或 samppipe ，这个任务的两个开源工具。对于教程，您应该阅读代码&这两个项目的文档。

You can use readability or boilerpipe, two open source tools for this task. For a tutorial you should read the code & documentation for those two projects.

这篇关于如何从网页中提取文本内容？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！