filmot.com
robots.txt
Robots Exclusion Standard data for filmot.com
Resource Scan
Scan Details
Site Domain | filmot.com |
Base Domain | filmot.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-14T02:34:14+00:00 |
Next Scan | 2025-01-13T02:34:14+00:00 |
Last Successful Scan
Scanned | 2024-08-24T02:32:47+00:00 |
URL | https://filmot.com/robots.txt |
Domain IPs | 104.21.56.237, 172.67.137.254, 2606:4700:3030::6815:38ed, 2606:4700:3030::ac43:89fe |
Response IP | 172.67.137.254 |
Found | Yes |
Hash | b04e5b99a758f1ecfe608fdacc3c112a00637ebf570542f91f2cbef66313be5b |
SimHash | 630767712ba7 |
Groups
*
Rule | Path |
---|---|
Disallow | /a/ |
Disallow | /gallery/ |
Disallow | /t/ |
Disallow | /user/ |
Disallow | /*.jpg$ |
Disallow | /*.gif$ |
Disallow | /search |
Disallow | /captionLanguageSearch |
Disallow | /unlistedSearch |
Disallow | /search/ |
Disallow | /captionLanguageSearch/ |
Disallow | /unlistedSearch/ |
Other Records
Field | Value |
---|---|
sitemap | https://filmot.com/sitemap.xml.gz |
Warnings
- 10 invalid lines.
Comments