fineart.ha.com
robots.txt
Robots Exclusion Standard data for fineart.ha.com
Resource Scan
Scan Details
| Site Domain | fineart.ha.com |
| Base Domain | ha.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T14:03:42+00:00 |
| Next Scan | 2024-11-25T14:03:42+00:00 |
Last Scan
| Scanned | 2024-11-11T14:03:42+00:00 |
| URL | https://fineart.ha.com/robots.txt |
| Domain IPs | 104.18.38.129, 172.64.149.127, 2606:4700:4400::6812:2681, 2606:4700:4400::ac40:957f |
| Response IP | 172.64.149.127 |
| Found | Yes |
| Hash | 66fefb3420b9e99b5caf9c17e198efe006078135f18377a05cbec45e5b9c90ec |
| SimHash | 13a4dcc1ceea |
Groups
mozilla/5.0 (compatible; gluten free crawler/1.0; +http://glutenfreepleasure.com/)
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /c/greetings.zx |
| Disallow | /c/ha-rebuttal.zx |
| Disallow | /c/cart/ |
| Disallow | /c/error/invalid-lot.zx |
| Disallow | /c/my/collection/ |
| Disallow | /c/bid-review.zx |
| Disallow | /c/bid.zx |
| Disallow | /c/prlink.zx |
| Disallow | /c/error/maintenance.zx |
| Disallow | /c/print-prices-realized.zx |
| Disallow | /c/catalog-print.zx |
| Disallow | /c/s/d/frontmatter/ |
| Disallow | /c/ecatalog.zx |
| Disallow | /c/auction-home.zx |
| Disallow | /c/invoice/ |
| Disallow | /c/rank.zx |
| Disallow | /c/moto/ |
| Disallow | /c/my/wantlist.zx |
| Disallow | /c/webservices/ebay-banner.zx |
| Disallow | /c/ebay-results.zx |
| Disallow | /c/phone-bid.zx |
| Disallow | /live.zx |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fineart.ha.com/sitemap.zx |