diskmovies.com
robots.txt

Robots Exclusion Standard data for diskmovies.com

Resource Scan

Scan Details

Site Domain diskmovies.com
Base Domain diskmovies.com
Scan Status Ok
Last Scan2026-01-07T22:52:29+00:00
Next Scan 2026-01-14T22:52:29+00:00

Last Scan

Scanned2026-01-07T22:52:29+00:00
URL https://diskmovies.com/robots.txt
Domain IPs 104.21.27.134, 172.67.142.160, 2606:4700:3034::6815:1b86, 2606:4700:3035::ac43:8ea0
Response IP 172.67.142.160
Found Yes
Hash 4d57beb9db771ba5aff4b3abde93152164a9d5a34e962958cfd20a31db381e0d
SimHash ed164c30c2a1

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /private/
Disallow /tmp/
Disallow /cgi-bin/
Disallow /*.php$
Disallow /*.js$
Disallow /*.css$

Comments

  • Crawl delay
  • Crawl-delay: 2