ha.com
robots.txt
Robots Exclusion Standard data for ha.com
Resource Scan
Scan Details
| Site Domain | ha.com |
| Base Domain | ha.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T01:33:30+00:00 |
| Next Scan | 2024-12-03T01:33:30+00:00 |
Last Scan
| Scanned | 2024-11-03T01:33:30+00:00 |
| URL | https://ha.com/robots.txt |
| Redirect | https://www.ha.com/robots.txt |
| Redirect Domain | www.ha.com |
| Redirect Base | ha.com |
| Domain IPs | 104.18.38.129, 172.64.149.127, 2606:4700:4400::6812:2681, 2606:4700:4400::ac40:957f |
| Redirect IPs | 104.18.38.129, 172.64.149.127, 2606:4700:4400::6812:2681, 2606:4700:4400::ac40:957f |
| Response IP | 172.64.149.127 |
| Found | Yes |
| Hash | a2f963731003f0216fffaf7ce9e3842ac6aad4998981dd3ae37efc8e2aaf844d |
| SimHash | 13a4dec18eea |
Groups
mozilla/5.0 (compatible; gluten free crawler/1.0; +http://glutenfreepleasure.com/)
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /c/greetings.zx |
| Disallow | /c/ha-rebuttal.zx |
| Disallow | /c/cart/ |
| Disallow | /c/error/invalid-lot.zx |
| Disallow | /c/my/collection/ |
| Disallow | /c/bid-review.zx |
| Disallow | /c/bid.zx |
| Disallow | /c/prlink.zx |
| Disallow | /c/error/maintenance.zx |
| Disallow | /c/print-prices-realized.zx |
| Disallow | /c/catalog-print.zx |
| Disallow | /c/s/d/frontmatter/ |
| Disallow | /c/ecatalog.zx |
| Disallow | /c/auction-home.zx |
| Disallow | /c/invoice/ |
| Disallow | /c/rank.zx |
| Disallow | /c/moto/ |
| Disallow | /c/my/wantlist.zx |
| Disallow | /c/webservices/ebay-banner.zx |
| Disallow | /c/ebay-results.zx |
| Disallow | /c/phone-bid.zx |
| Disallow | /live.zx |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ha.com/sitemap.zx |