filmwatch.com
robots.txt
Robots Exclusion Standard data for filmwatch.com
Resource Scan
Scan Details
Site Domain | filmwatch.com |
Base Domain | filmwatch.com |
Scan Status | Ok |
Last Scan | 2024-07-03T16:48:45+00:00 |
Next Scan | 2024-07-10T16:48:45+00:00 |
Last Scan
Scanned | 2024-07-03T16:48:45+00:00 |
URL | https://filmwatch.com/robots.txt |
Domain IPs | 104.21.34.97, 172.67.158.225, 2606:4700:3034::6815:2261, 2606:4700:3036::ac43:9ee1 |
Response IP | 172.67.158.225 |
Found | Yes |
Hash | 5cee75bd5f6a6078a370696ee33e21e2a3e3f13b5ce56d580e1a9d97625711a0 |
SimHash | 4b0bce528d21 |
Groups
*
Rule | Path |
---|---|
Disallow | */clickoutcredit/* |
Disallow | */clickout/* |
Disallow | */redirecttocomment/* |
Disallow | */clickoutaltsource/* |
Disallow | /wp-admin/ |
Disallow | /*?ignorenitro=* |
Disallow | */?%2F* |
Disallow | /cdn-cgi/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://filmwatch.com/sitemaps/storyindex |