如何在robots.txt中添加`nofollow, noindex`所有页面? [英] How to add `nofollow, noindex` all pages in robots.txt?

问题描述

我想在网站构建过程中将 nofollow 和 noindex 添加到我的网站.客户要求我使用这些规则.

I want to add nofollow and noindex to my site whilst it's being built. The client has request I use these rules.

我知道

<meta name="robots" content="noindex,nofollow">

但我只能访问 robots.txt 文件.

But I only have access to the robots.txt file.

有谁知道我可以用来通过 robots.txt 文件应用 noindex, nofollow 规则的正确格式吗?

Does anyone know the correct format I can use to apply noindex, nofollow rules via the robots.txt file?

推荐答案

noindex 和 nofollow 意味着您不希望您的网站在搜索引擎中爬行.

noindex and nofollow means you do not want your site to crawl in search engine.

所以只需将代码放在 robots.txt 中

so simply put code in robots.txt

User-agent: *
Disallow: /

表示 noindex 和 nofollow.

it means noindex and nofollow.

这篇关于如何在robots.txt中添加`nofollow, noindex`所有页面?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！