ziarecords.com
robots.txt
Robots Exclusion Standard data for ziarecords.com
Resource Scan
Scan Details
| Site Domain | ziarecords.com |
| Base Domain | ziarecords.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T20:11:04+00:00 |
| Next Scan | 2024-12-09T20:11:04+00:00 |
Last Scan
| Scanned | 2024-11-09T20:11:04+00:00 |
| URL | https://ziarecords.com/robots.txt |
| Redirect | http://www.ziarecords.com/robots.txt |
| Redirect Domain | www.ziarecords.com |
| Redirect Base | ziarecords.com |
| Domain IPs | 162.252.178.40 |
| Redirect IPs | 162.252.178.40 |
| Response IP | 162.252.178.40 |
| Found | Yes |
| Hash | 2ca37f41a58b1f207a7e6d9ea4733a260d66b6e23e5c25634bfff76ed565375f |
| SimHash | 33e64ab8ca2b |
Groups
etaospider
yandex
moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /rel/ |
| Disallow | /dev/ |
| Disallow | /search/ |
| Disallow | /scripts/ |
| Disallow | /bin/ |
| Disallow | /content/files/ |
| Disallow | /install |
| Disallow | /compareproducts |
| Disallow | /clearcomparelist |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /cart |
| Disallow | /wishlist |
| Disallow | /emailwishlist |
| Disallow | /checkout |
| Disallow | /onepagecheckout |
| Disallow | /checkout/shippingaddress |
| Disallow | /checkout/billingaddress |
| Disallow | /checkout/shippingmethod |
| Disallow | /checkout/paymentmethod |
| Disallow | /checkout/paymentinfo |
| Disallow | /checkout/confirm |
| Disallow | /checkout/completed |
| Disallow | /orderdetails |
| Disallow | /returnrequest |
| Disallow | /passwordrecovery/confirm |
| Disallow | /newsletter/subscriptionactivation |
| Disallow | /customer/activation |
| Disallow | /customer/forumsubscriptions |
| Disallow | /emailwishlist |
| Disallow | /boards/postedit |
| Disallow | /boards/postdelete |
| Disallow | /boards/postcreate |
| Disallow | /boards/topicedit |
| Disallow | /boards/topicdelete |
| Disallow | /boards/topiccreate |
| Disallow | /boards/topicmove |
| Disallow | /boards/topicwatch |
| Disallow | /boards/forumwatch |
| Disallow | /privatemessages |
| Disallow | /inboxupdate |
| Disallow | /sentupdate |
| Disallow | /sendpm |
| Disallow | /viewpm |
| Disallow | /deletepm |
| Disallow | /search/artistid |
| Disallow | /publishdate |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ziarecords.com/sitemapindex.xml |