ratehawk.com
robots.txt
Robots Exclusion Standard data for ratehawk.com
Resource Scan
Scan Details
| Site Domain | ratehawk.com |
| Base Domain | ratehawk.com |
| Scan Status | Ok |
| Last Scan | 2024-11-02T14:06:46+00:00 |
| Next Scan | 2024-11-16T14:06:46+00:00 |
Last Scan
| Scanned | 2024-11-02T14:06:46+00:00 |
| URL | https://ratehawk.com/robots.txt |
| Redirect | https://www.ratehawk.com/robots.txt |
| Redirect Domain | www.ratehawk.com |
| Redirect Base | ratehawk.com |
| Domain IPs | 104.18.39.91, 172.64.148.165, 2606:4700:4400::6812:275b, 2606:4700:4400::ac40:94a5 |
| Redirect IPs | 104.18.39.91, 172.64.148.165, 2606:4700:4400::6812:275b, 2606:4700:4400::ac40:94a5 |
| Response IP | 172.64.148.165 |
| Found | Yes |
| Hash | 15c97db64118144b7124487c384a19dfb64da4b7659b2370d23780ee6cedd2b9 |
| SimHash | 0c500842be90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *partner_slug |
| Disallow | *utm_source |
| Disallow | *utm_medium |
| Disallow | *utm_campaign |
| Disallow | *utm_content |
| Disallow | *_openstat |
| Disallow | *q%3D |
| Disallow | *dates%3D |
| Disallow | *guests%3D |
| Disallow | *price%3D |
| Disallow | *sid%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ratehawk.com/sitemap.xml |