crane-locator.com
robots.txt
Robots Exclusion Standard data for crane-locator.com
Resource Scan
Scan Details
| Site Domain | crane-locator.com |
| Base Domain | crane-locator.com |
| Scan Status | Ok |
| Last Scan | 2025-04-27T08:13:18+00:00 |
| Next Scan | 2025-05-27T08:13:18+00:00 |
Last Scan
| Scanned | 2025-04-27T08:13:18+00:00 |
| URL | https://crane-locator.com/robots.txt |
| Domain IPs | 104.21.50.71, 172.67.158.119, 2606:4700:3033::ac43:9e77, 2606:4700:3036::6815:3247 |
| Response IP | 172.67.158.119 |
| Found | Yes |
| Hash | 30c8808fdd3d23cc581e8db751d992d7d5f8704502fbf1a3358a28db078098de |
| SimHash | 28a88d064bdd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /login* |
| Disallow | /*utm_source* |
| Disallow | /*gclid%3D |
| Disallow | /edit-profile/ |
| Disallow | /profile/ |
| Disallow | /invitation* |
| Disallow | /logout* |
| Disallow | /password-change* |
| Disallow | /register* |
| Disallow | /fb-login* |
| Disallow | /password* |
| Disallow | /search-results* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://crane-locator.com/sitemap.xml |
Warnings
- `host` is not a known field.