[wp-trac] [WordPress Trac] #58751: Add noindex to 404 template (was: we had the same problem, but spam links use tags, a follow-up to #52457)

[WordPress Trac]

#58751: Add noindex to 404 template
--------------------------+------------------------------
 Reporter:  patrickggg    |       Owner:  (none)
     Type:  defect (bug)  |      Status:  new
 Priority:  normal        |   Milestone:  Awaiting Review
Component:  General       |     Version:
 Severity:  normal        |  Resolution:
 Keywords:  needs-patch   |     Focuses:
--------------------------+------------------------------
Changes (by sabernhardt):

 * keywords:   => needs-patch


Old description:

> This is a follow-up to #52457.
>
> we had the same problem, but spam links use tags, they don't directly
> intrude on our website. How do we add the code so that google doesn't
> index it?
>
> Example:
>
> https://hideurl.com/tag/%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-(%E2%8F%A9%E5%8A%9E%E8%AF%81%E7%BD%91%E7%AB%99%E2%9C%94%EF%B8%8Fbbjjzz.com%E2%8F%AA)-%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-%E5%8A%9E%E5%81%87%E8%8B%B1%E5%9B%BD%E8%B5%AB%E7%89%B9%E7%A6%8F%E5%BE%B7%E5%A4%A7%E5%AD%A6%E5%AD%A6%E5%8E%86%E6%96%87%E5%87%AD%E4%B8%8A%E6%B5%B7%E9%87%91%E5%B1%B1%E5%8C%BA-%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-(%E2%8F%A9%E5%8A%9E%E8%AF%81%E7%BD%91%E7%AB%99%E2%9C%94%EF%B8%8Fbbjjzz.com%E2%8F%AA)-%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-%E5%8A%9E%E5%81%87%E8%8B%B1%E5%9B%BD%E8%B5%AB%E7%89%B9%E7%A6%8F%E5%BE%B7%E5%A4%A7%E5%AD%A6%E5%AD%A6%E5%8E%86%E6%96%87%E5%87%AD

New description:

 This is a follow-up to #52457.

 we had the same problem, but spam links use tags, they don't directly
 intrude on our website. How do we add the code so that google doesn't
 index it?

 Example:

 `https://example.com/tag/%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-(%E2%8F%A9%E5%8A%9E%E8%AF%81%E7%BD%91%E7%AB%99%E2%9C%94%EF%B8%8Fbbjjzz.com%E2%8F%AA)-%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-%E5%8A%9E%E5%81%87%E8%8B%B1%E5%9B%BD%E8%B5%AB%E7%89%B9%E7%A6%8F%E5%BE%B7%E5%A4%A7%E5%AD%A6%E5%AD%A6%E5%8E%86%E6%96%87%E5%87%AD%E4%B8%8A%E6%B5%B7%E9%87%91%E5%B1%B1%E5%8C%BA-%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-(%E2%8F%A9%E5%8A%9E%E8%AF%81%E7%BD%91%E7%AB%99%E2%9C%94%EF%B8%8Fbbjjzz.com%E2%8F%AA)-%E5%81%87%E5%A4%9A%E5%93%A5%E5%AD%A6%E5%8E%86%E6%88%90%E7%BB%A9%E5%8D%95-%E5%8A%9E%E5%81%87%E8%8B%B1%E5%9B%BD%E8%B5%AB%E7%89%B9%E7%A6%8F%E5%BE%B7%E5%A4%A7%E5%AD%A6%E5%AD%A6%E5%8E%86%E6%96%87%E5%87%AD`

--

Comment:

 Hi and welcome to WordPress Core Trac!

 When I visited a nonexistent tag archive, these were the `robots` meta
 tags:

 **Core** default (trunk)
 `<meta name='robots' content='max-image-preview:large' />`

 **All in One SEO** 4.9.5.1
 `<meta name="robots" content="noindex" />`
 (plugin has an `aioseo_404_robots` filter to override this specifically)

 **Yoast SEO** 27.3
 `<meta name='robots' content='noindex, follow' />`

-- 
Ticket URL: <https://core.trac.wordpress.org/ticket/58751#comment:1>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform