[wp-trac] [WordPress Trac] #18465: Prevent search engines from indexing wp-admin and wp-includes

[WordPress Trac]

#18465: Prevent search engines from indexing wp-admin and wp-includes
--------------------------+---------------------
 Reporter:  Viper007Bond  |       Owner:  ryan
     Type:  enhancement   |      Status:  closed
 Priority:  lowest        |   Milestone:  3.4
Component:  General       |     Version:  3.2.1
 Severity:  trivial       |  Resolution:  fixed
 Keywords:  has-patch     |
--------------------------+---------------------

Comment (by joostdevalk):

 Replying to [comment:38 koebenhavn event]:
 > Just to clarify.
 >
 > It is only partially true that the robot.txt does not inhibit/request
 crawlers no avoid indexing. For instance while the actual URL and anchor
 text might be found in the google index, if searching specificly for it,
 the crawler will not index the actual contend of the page. What the google
 help page says is that you would have to know and search for the specific
 URL or anchor text to find it in the google index, and would not see the
 actual content.
 >
 > /Event
 >

 Do a search for inurl:wp-admin/admin-ajax.php and you'll see there are
 loads and loads of sites there that actually show up. That's why this is
 an issue.

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/18465#comment:39>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software