是否允许 Web 开发人员抓取 html 内容? [英] Are web developers allowed to scrape html content?

问题描述

我想从几个网站上抓取 html 内容，然后在我的网站上以一种混搭形式查看它们.我也会参考并链接到它们！

I want to scrape html content from a couple of websites and view them on my website a kind of mashup. I will reference and link to them aswelll!

谢谢

推荐答案

继续做，但检查他们的 robots.txt 并确保他们在遇到问题时可以联系您.大多数人会很高兴从您的混搭中获得流量.无论如何，他们有责任要求您不要这样做.

Go ahead and do it but check their robots.txt and make sure there is a way for them to contact you if they have a problem with it. Most people will be happy to get traffic from your mash-up. Anyway the burden is on them to ask you not to.

这篇关于是否允许 Web 开发人员抓取 html 内容?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！