mycrewkit.com
robots.txt

Robots Exclusion Standard data for mycrewkit.com

Resource Scan

Scan Details

Site Domain mycrewkit.com
Base Domain mycrewkit.com
Scan Status Ok
Last Scan2025-07-02T12:22:55+00:00
Next Scan 2025-08-01T12:22:55+00:00

Last Scan

Scanned2025-07-02T12:22:55+00:00
URL https://mycrewkit.com/robots.txt
Domain IPs 104.21.52.220, 172.67.204.93, 2606:4700:3034::6815:34dc, 2606:4700:3035::ac43:cc5d
Response IP 104.21.52.220
Found Yes
Hash 1eb075433e9c7476a2439b2b33f719c0c79a75170ea4e169a624ef2914b53ffc
SimHash 6508d8c0c991

Groups

*

Rule Path
Disallow /old/

Other Records

Field Value
crawl-delay 30