moviesbark.com
robots.txt
Robots Exclusion Standard data for moviesbark.com
Resource Scan
Scan Details
Site Domain | moviesbark.com |
Base Domain | moviesbark.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-04-25T07:48:04+00:00 |
Next Scan | 2024-05-25T07:48:04+00:00 |
Last Successful Scan
Scanned | 2024-03-04T07:46:33+00:00 |
URL | https://moviesbark.com/robots.txt |
Domain IPs | 104.21.40.2, 172.67.172.215, 2606:4700:3031::6815:2802, 2606:4700:3032::ac43:acd7 |
Response IP | 172.67.172.215 |
Found | Yes |
Hash | 8bd8e39828e77facc273b219e59d949124bb002ef0a6dac395fe53f545636a89 |
SimHash | 6544575bc756 |
Groups
*
Rule | Path |
---|---|
Allow | /post/ |
Allow | /posts/ |
Disallow | / |
Warnings
- 1 invalid line.
- `noindex` is not a known field.