crewmirror.com
robots.txt
Robots Exclusion Standard data for crewmirror.com
Resource Scan
Scan Details
Site Domain | crewmirror.com |
Base Domain | crewmirror.com |
Scan Status | Ok |
Last Scan | 2025-06-22T08:08:46+00:00 |
Next Scan | 2025-06-29T08:08:46+00:00 |
Last Scan
Scanned | 2025-06-22T08:08:46+00:00 |
URL | https://crewmirror.com/robots.txt |
Domain IPs | 2a02:4780:84:cc36:f59d:c80a:ec3:f341, 2a02:4780:84:e5ff:9372:5af6:9126:410, 84.32.84.129, 84.32.84.227 |
Response IP | 93.127.201.252 |
Found | Yes |
Hash | 943b51675a72245b2d3605e7efd00d29c16ae9e3c43b2b0d2b8ec544f7c24d31 |
SimHash | 49008057c533 |
Other Records
Field | Value |
---|---|
sitemap | https://crewmirror.com/sitemap.xml |