hamiltoncompany.com
robots.txt
Robots Exclusion Standard data for hamiltoncompany.com
Resource Scan
Scan Details
| Site Domain | hamiltoncompany.com |
| Base Domain | hamiltoncompany.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-23T12:01:57+00:00 |
| Next Scan | 2026-03-25T12:01:57+00:00 |
Last Successful Scan
| Scanned | 2026-01-25T12:01:09+00:00 |
| URL | https://hamiltoncompany.com/robots.txt |
| Redirect | https://www.hamiltoncompany.com/robots.txt |
| Redirect Domain | www.hamiltoncompany.com |
| Redirect Base | hamiltoncompany.com |
| Domain IPs | 104.26.12.58, 104.26.13.58, 172.67.72.202, 2606:4700:20::681a:c3a, 2606:4700:20::681a:d3a, 2606:4700:20::ac43:48ca |
| Redirect IPs | 104.26.12.58, 104.26.13.58, 172.67.72.202, 2606:4700:20::681a:c3a, 2606:4700:20::681a:d3a, 2606:4700:20::ac43:48ca |
| Response IP | 104.26.12.58 |
| Found | Yes |
| Hash | 9c3e0380f5014db8b9814e57a6d53d89c473c9790e283147919650b98a81df12 |
| SimHash | 6d3cdc7543f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /rfq |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /account |
| Disallow | /admin |
| Disallow | /*?token= |
| Disallow | /*%26token%3D |
| Disallow | /*?page= |
| Disallow | /*%26page%3D |
| Disallow | /*?query= |
| Disallow | /*%26query%3D |
| Disallow | /*?utm_campaign= |
| Disallow | /*%26utm_campaign%3D |
| Disallow | /*?utm_medium= |
| Disallow | /*%26utm_medium%3D |
| Disallow | /*?compound= |
| Disallow | /*%26compound%3D |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
ahrefssiteaudit
ahrefsbot
semrushbot
| Rule | Path |
|---|---|
| Disallow | /index.php?p=actions%2F |
| Disallow | /ajax/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hamiltoncompany.com/sitemaps/index.xml |
Comments