crewmirror.com
robots.txt

Robots Exclusion Standard data for crewmirror.com

Resource Scan

Scan Details

Site Domain crewmirror.com
Base Domain crewmirror.com
Scan Status Ok
Last Scan2025-06-22T08:08:46+00:00
Next Scan 2025-06-29T08:08:46+00:00

Last Scan

Scanned2025-06-22T08:08:46+00:00
URL https://crewmirror.com/robots.txt
Domain IPs 2a02:4780:84:cc36:f59d:c80a:ec3:f341, 2a02:4780:84:e5ff:9372:5af6:9126:410, 84.32.84.129, 84.32.84.227
Response IP 93.127.201.252
Found Yes
Hash 943b51675a72245b2d3605e7efd00d29c16ae9e3c43b2b0d2b8ec544f7c24d31
SimHash 49008057c533

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://crewmirror.com/sitemap.xml