cafepress.com.au
robots.txt
Robots Exclusion Standard data for cafepress.com.au
Resource Scan
Scan Details
Site Domain | cafepress.com.au |
Base Domain | cafepress.com.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-06T19:30:03+00:00 |
Next Scan | 2024-11-05T19:30:03+00:00 |
Last Successful Scan
Scanned | 2024-07-09T19:28:33+00:00 |
URL | https://cafepress.com.au/robots.txt |
Domain IPs | 108.156.133.22, 108.156.133.31, 108.156.133.60, 108.156.133.99 |
Response IP | 108.156.133.99 |
Found | Yes |
Hash | f0ea1a0e15d71a5297594d5363efe5a05313ab011cf2a64f69bdb8280384032b |
SimHash | 69224b9588f0 |
Groups
*
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/members/login.aspx |
Disallow | /login |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
Disallow | /7577 |
Disallow | /chrissyhstudios |
Disallow | /dreambarkscom |
Disallow | /eastovergraphic |
Disallow | /everybodyshirts |
Disallow | /gettyimages |
Disallow | /iloveshirt |
Disallow | /italianthings |
Disallow | /jackynet |
Disallow | /javatime |
Disallow | /laststopshop |
Disallow | /lawrenceshoppe |
Disallow | /petdrawings |
Disallow | /policeshoppe |
Disallow | /politiclothes |
Disallow | /religion_tshirt |
Disallow | /scott64 |
Disallow | /tvtee |
Disallow | /w2arts |
Disallow | /cart |
Disallow | /checkout |
Disallow | /order-confirm |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
adsbot-google
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
Disallow | /7577 |
Disallow | /chrissyhstudios |
Disallow | /dreambarkscom |
Disallow | /eastovergraphic |
Disallow | /everybodyshirts |
Disallow | /gettyimages |
Disallow | /iloveshirt |
Disallow | /italianthings |
Disallow | /jackynet |
Disallow | /javatime |
Disallow | /laststopshop |
Disallow | /lawrenceshoppe |
Disallow | /petdrawings |
Disallow | /policeshoppe |
Disallow | /politiclothes |
Disallow | /religion_tshirt |
Disallow | /scott64 |
Disallow | /tvtee |
Disallow | /w2arts |
bingbot
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
googlebot*
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
Disallow | /7577 |
Disallow | /chrissyhstudios |
Disallow | /dreambarkscom |
Disallow | /eastovergraphic |
Disallow | /everybodyshirts |
Disallow | /gettyimages |
Disallow | /iloveshirt |
Disallow | /italianthings |
Disallow | /jackynet |
Disallow | /javatime |
Disallow | /laststopshop |
Disallow | /lawrenceshoppe |
Disallow | /petdrawings |
Disallow | /policeshoppe |
Disallow | /politiclothes |
Disallow | /religion_tshirt |
Disallow | /scott64 |
Disallow | /tvtee |
Disallow | /w2arts |
mediapartners-google*
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
Disallow | /7577 |
Disallow | /chrissyhstudios |
Disallow | /dreambarkscom |
Disallow | /eastovergraphic |
Disallow | /everybodyshirts |
Disallow | /gettyimages |
Disallow | /iloveshirt |
Disallow | /italianthings |
Disallow | /jackynet |
Disallow | /javatime |
Disallow | /laststopshop |
Disallow | /lawrenceshoppe |
Disallow | /petdrawings |
Disallow | /policeshoppe |
Disallow | /politiclothes |
Disallow | /religion_tshirt |
Disallow | /scott64 |
Disallow | /tvtee |
Disallow | /w2arts |
msnbot*
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
bingpreview
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
adidxbot
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
slurp
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout/ |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
Other Records
Field | Value |
---|---|
sitemap | https://www.cafepress.com.au/sitemaps/sitemap-index.xml |
Warnings
- 2 invalid lines.
Comments