[wp-hackers] Robots.txt

[Graeme Lennon]

Aren't we redirecting everything in index.php now? Make it a rewrite
rule: if robots.txt exists, use it, otherwise output something reasonable.

g.

Denis de Bernardy wrote:
> make that a robots-sample.txt
> 
> I'd hate to loose my robots.txt by mistake.
> 
> D.
> 
> 
> 
>> -----Original Message-----
>> From: wp-hackers-bounces at lists.automattic.com 
>> [mailto:wp-hackers-bounces at lists.automattic.com] On Behalf Of 
>> David Munn
>> Sent: Wednesday, November 23, 2005 5:45 PM
>> To: wp-hackers at lists.automattic.com
>> Subject: [wp-hackers] Robots.txt
>>
>>
>> I was thinking it would be a good idea to include a simple robots.txt 
>> file within the Wordpress release to block of bot access to the 
>> wp-admin, wp-includes, and wp-content directories.
>>
>> opinions?
>>
>> David Munn
>> _______________________________________________
>> wp-hackers mailing list
>> wp-hackers at lists.automattic.com 
>> http://lists.automattic.com/mailman/listinfo/wp-hackers
>>
> 
> _______________________________________________
> wp-hackers mailing list
> wp-hackers at lists.automattic.com
> http://lists.automattic.com/mailman/listinfo/wp-hackers
>