如何在robots.txt中的所有页面上添加`nofollow，noindex`? [英] How to add `nofollow, noindex` all pages in robots.txt?

问题描述

我要在构建站点时将nofollow和noindex添加到我的站点.客户要求我使用这些规则.

I want to add nofollow and noindex to my site whilst it's being built. The client has request I use these rules.

我知道

<meta name="robots" content="noindex,nofollow">

但是我只能访问robots.txt文件.

有人知道我可以通过robots.txt文件应用noindex, nofollow规则的正确格式吗?

Does anyone know the correct format I can use to apply noindex, nofollow rules via the robots.txt file?

推荐答案

noindex和nofollow表示您不希望自己的网站在搜索引擎中爬网.

noindex and nofollow means you do not want your site to crawl in search engine.

因此只需将代码放在robots.txt中 User-agent: * Disallow: /

so simply put code in robots.txt User-agent: * Disallow: /

它表示noindex和nofollow.

it means noindex and nofollow.

这篇关于如何在robots.txt中的所有页面上添加`nofollow，noindex`?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！