coins.ha.com
robots.txt
Robots Exclusion Standard data for coins.ha.com
Resource Scan
Scan Details
Site Domain | coins.ha.com |
Base Domain | ha.com |
Scan Status | Ok |
Last Scan | 2024-11-07T07:12:32+00:00 |
Next Scan | 2024-12-07T07:12:32+00:00 |
Last Scan
Scanned | 2024-11-07T07:12:32+00:00 |
URL | https://coins.ha.com/robots.txt |
Domain IPs | 104.18.38.129, 172.64.149.127, 2606:4700:4400::6812:2681, 2606:4700:4400::ac40:957f |
Response IP | 104.18.38.129 |
Found | Yes |
Hash | d7cba5631976b1c0da84de2c3a4812cf88bab128ab012c97012620ccfc5060e6 |
SimHash | 13a4dcc1ceea |
Groups
mozilla/5.0 (compatible; gluten free crawler/1.0; +http://glutenfreepleasure.com/)
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /c/greetings.zx |
Disallow | /c/ha-rebuttal.zx |
Disallow | /c/cart/ |
Disallow | /c/error/invalid-lot.zx |
Disallow | /c/my/collection/ |
Disallow | /c/bid-review.zx |
Disallow | /c/bid.zx |
Disallow | /c/prlink.zx |
Disallow | /c/error/maintenance.zx |
Disallow | /c/print-prices-realized.zx |
Disallow | /c/catalog-print.zx |
Disallow | /c/s/d/frontmatter/ |
Disallow | /c/ecatalog.zx |
Disallow | /c/auction-home.zx |
Disallow | /c/invoice/ |
Disallow | /c/rank.zx |
Disallow | /c/moto/ |
Disallow | /c/my/wantlist.zx |
Disallow | /c/webservices/ebay-banner.zx |
Disallow | /c/ebay-results.zx |
Disallow | /c/phone-bid.zx |
Disallow | /live.zx |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
Other Records
Field | Value |
---|---|
sitemap | https://coins.ha.com/sitemap.zx |