moviemistakes.com
robots.txt
Robots Exclusion Standard data for moviemistakes.com
Resource Scan
Scan Details
Site Domain | moviemistakes.com |
Base Domain | moviemistakes.com |
Scan Status | Ok |
Last Scan | 2024-07-03T00:40:13+00:00 |
Next Scan | 2024-07-10T00:40:13+00:00 |
Last Scan
Scanned | 2024-07-03T00:40:13+00:00 |
URL | https://moviemistakes.com/robots.txt |
Domain IPs | 209.68.14.195 |
Response IP | 209.68.14.195 |
Found | Yes |
Hash | 76f5a71b71f958c469166a867723d54c6c6d7362ca6a71e548d2fcc61f9debcb |
SimHash | 6c28d800c692 |
Groups
*
Rule | Path |
---|---|
Disallow | /movieadmin/ |
Disallow | /phpBB2/ |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.moviemistakes.com/sitemap-index.xml.gz |