fellowsfilm.com
robots.txt
Robots Exclusion Standard data for fellowsfilm.com
Resource Scan
Scan Details
Site Domain | fellowsfilm.com |
Base Domain | fellowsfilm.com |
Scan Status | Ok |
Last Scan | 2024-09-20T21:33:19+00:00 |
Next Scan | 2024-09-27T21:33:19+00:00 |
Last Scan
Scanned | 2024-09-20T21:33:19+00:00 |
URL | https://fellowsfilm.com/robots.txt |
Domain IPs | 104.26.14.21, 104.26.15.21, 172.67.73.14, 2606:4700:20::681a:e15, 2606:4700:20::681a:f15, 2606:4700:20::ac43:490e |
Response IP | 104.26.14.21 |
Found | Yes |
Hash | 484f2568ec0797dfb8c3532bb999f45e1a6ede231c3dc97bc1cd31796d2f7abd |
SimHash | 4478de70c3a7 |
Groups
*
Rule | Path |
---|---|
Disallow | /find-new/ |
Disallow | /account/ |
Disallow | /attachments/ |
Disallow | /goto/ |
Disallow | /posts/ |
Disallow | /login/ |
Disallow | /admin.php |
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://fellowsfilm.com/sitemap.php |