hobbs.com
robots.txt
Robots Exclusion Standard data for hobbs.com
Resource Scan
Scan Details
| Site Domain | hobbs.com |
| Base Domain | hobbs.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-14T12:12:16+00:00 |
| Next Scan | 2025-10-13T12:12:16+00:00 |
Last Successful Scan
| Scanned | 2025-05-24T01:57:05+00:00 |
| URL | https://hobbs.com/robots.txt |
| Redirect | https://www.hobbs.com/robots.txt |
| Redirect Domain | www.hobbs.com |
| Redirect Base | hobbs.com |
| Domain IPs | 104.16.215.106 |
| Redirect IPs | 104.17.137.26, 104.18.142.19 |
| Response IP | 104.17.137.26 |
| Found | Yes |
| Hash | b43d28f8549f71d96919a241378945f3983cc2b313c41742fac46e0850ab106a |
| SimHash | 3d4ecc4ced52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /*prefn1* |
| Disallow | /*prefn2* |
| Disallow | /*prefn3* |
| Disallow | /*prefn4* |
| Disallow | /*prefv1* |
| Disallow | /*prefv2* |
| Disallow | /*prefv3* |
| Disallow | /*prefv4* |
| Disallow | /*pmin* |
| Disallow | /*pmax* |
| Disallow | /*srule* |
| Disallow | /Tile-AddToBagOverlay* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hobbs.com/sitemap_index.xml |