crescent.co
robots.txt
Robots Exclusion Standard data for crescent.co
Resource Scan
Scan Details
Site Domain | crescent.co |
Base Domain | crescent.co |
Scan Status | Ok |
Last Scan | 2024-11-07T16:11:06+00:00 |
Next Scan | 2024-12-07T16:11:06+00:00 |
Last Scan
Scanned | 2024-11-07T16:11:06+00:00 |
URL | https://crescent.co/robots.txt |
Domain IPs | 76.76.21.164, 76.76.21.22 |
Response IP | 76.76.21.164 |
Found | Yes |
Hash | 6aa6a5b8f3d126261cc4740578b6431683dc014947cf86cb7b275f95572ec52e |
SimHash | 4d549f4545b1 |
Other Records
Field | Value |
---|---|
sitemap | https://crescent.co/sitemap.xml |
sitemap | https://crescent.co/server-sitemap.xml |
Warnings
- `host` is not a known field.
Comments