moviemistakes.com
robots.txt

Robots Exclusion Standard data for moviemistakes.com

Resource Scan

Scan Details

Site Domain moviemistakes.com
Base Domain moviemistakes.com
Scan Status Ok
Last Scan2024-07-03T00:40:13+00:00
Next Scan 2024-07-10T00:40:13+00:00

Last Scan

Scanned2024-07-03T00:40:13+00:00
URL https://moviemistakes.com/robots.txt
Domain IPs 209.68.14.195
Response IP 209.68.14.195
Found Yes
Hash 76f5a71b71f958c469166a867723d54c6c6d7362ca6a71e548d2fcc61f9debcb
SimHash 6c28d800c692

Groups

mediapartners-google

Rule Path
Disallow

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /movieadmin/
Disallow /phpBB2/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.moviemistakes.com/sitemap-index.xml.gz