从网站提取数据 [英] Extract data from web site

查看:98
本文介绍了从网站提取数据的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

有没有办法从网站上收集成分,评级,用户等数据,如http://liquor.com/slideshows/,http://allrecipes.com/recipes/drinks/cocktails/,其中包含制作鸡尾酒......?我在clojure中构建应用程序,所以我需要真正的数据来填充我的数据库!我需要大量数据,因此从每个特定配方中提取数据是不切实际的。有没有办法从当时的多个配方中获取数据?

Is there a way to colect data like ingredients, ratings, users from web site like http://liquor.com/slideshows/, http://allrecipes.com/recipes/drinks/cocktails/ that contains a recipe for making cocktails... ? I m building application in clojure, so i need real data to fill in my database! I need big amount of data so it is impractical to extract the data from each particular recipe. Is there a way to get data from more then one recipe at the time?

推荐答案

由于您无法直接访问其数据库,您必须使用任何API该网站可能已经开发或使用WebClient基本上获取HTML,然后你将不得不解析它。



https://msdn.microsoft.com/en-us/library/system.net.webclient% 28v = vs.110%29.aspx [ ^ ]
Since you can't access their database directly you either have to use any APIs that the site may have developed or use the WebClient to essentially get the html and then you'll have to parse it.

https://msdn.microsoft.com/en-us/library/system.net.webclient%28v=vs.110%29.aspx[^]


这篇关于从网站提取数据的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆