Web - Robots.txt

> (World Wide) Web - (W3|WWW)

1 - About

robots.txt file gives information to the Web Bot crawling your website.

Advertising

3 - Syntax

4 - Documentation