cafepress.com
robots.txt
Robots Exclusion Standard data for cafepress.com
Resource Scan
Scan Details
Site Domain | cafepress.com |
Base Domain | cafepress.com |
Scan Status | Ok |
Last Scan | 2024-06-28T15:47:02+00:00 |
Next Scan | 2024-07-05T15:47:02+00:00 |
Last Scan
Scanned | 2024-06-28T15:47:02+00:00 |
URL | https://cafepress.com/robots.txt |
Domain IPs | 52.84.229.10, 52.84.229.105, 52.84.229.57, 52.84.229.9 |
Response IP | 52.84.229.105 |
Found | Yes |
Hash | f3f682643d202059e6cb9650da1984408792e1e7cf03d513aedd78987f7f95d7 |
SimHash | 61265b9388f0 |
Groups
*
Rule | Path |
---|---|
Disallow | /cp/catalogExp/addtocarthelper.aspx |
Disallow | /cp/catalog/addtocarthelper.aspx |
Disallow | /cp/catalogexp/retail_service.aspx |
Disallow | /cp/get_latest_product_view.aspx |
Disallow | /cp/international/currency.aspx |
Disallow | /cp/members/join.aspx |
Disallow | /cp/members/login.aspx |
Disallow | /login |
Disallow | /cp/popup/index.aspx |
Disallow | /cp/viewcart.aspx |
Disallow | /m/recommendations/searches |
Disallow | /cp/checkout |
Disallow | /cp/moredetails.aspx |
Disallow | /cp/shareitem.aspx |
Disallow | /7577 |
Disallow | /chrissyhstudios |
Disallow | /dreambarkscom |
Disallow | /eastovergraphic |
Disallow | /everybodyshirts |
Disallow | /gettyimages |
Disallow | /iloveshirt |
Disallow | /italianthings |
Disallow | /jackynet |
Disallow | /javatime |
Disallow | /laststopshop |
Disallow | /lawrenceshoppe |
Disallow | /petdrawings |
Disallow | /policeshoppe |
Disallow | /politiclothes |
Disallow | /religion_tshirt |
Disallow | /scott64 |
Disallow | /tvtee |
Disallow | /w2arts |
Disallow | /cart |
Disallow | /checkout |
Disallow | /order-confirm |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.cafepress.com/sitemaps/sitemap-index.xml |
Warnings
- 2 invalid lines.
Comments