robots.txt Checker
Read your robots.txt, see what it allows and blocks, and find rules that block important pages by accident.
We fetch and parse your robots.txt and show what each rule group actually does.
Read your robots.txt, see what it allows and blocks, and find rules that block important pages by accident.
We fetch and parse your robots.txt and show what each rule group actually does.