Log In Sign Up

readoverlord.com
robots.txt

Robots Exclusion Standard data for readoverlord.com

Resource Scan

Scan Details

Site Domain readoverlord.com
Base Domain readoverlord.com
Scan Status Ok
Last Scan2025-08-08T04:14:34+00:00
Next Scan 2025-09-07T04:14:34+00:00

Last Scan

Scanned2025-08-08T04:14:34+00:00
URL https://readoverlord.com/robots.txt
Domain IPs 104.21.8.71, 172.67.156.233, 2606:4700:3031::6815:847, 2606:4700:3034::ac43:9ce9
Response IP 104.21.8.71
Found Yes
Hash fbe19a603619e6dfa0bb3eabaa043efe435f6c0be72c71251b727340fdda1c2b
SimHash 0b14d2104723

Groups

*

Rule Path
Allow /

dmcaagent

Rule Path
Disallow /

copyrightcrawler

Rule Path
Disallow /

antipiracybot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

goo-crawler

Rule Path
Disallow /

rakutenbot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

link-busterbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://readoverlord.com/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top