smokeday.com
robots.txt

Robots Exclusion Standard data for smokeday.com

Resource Scan

Scan Details

Site Domain smokeday.com
Base Domain smokeday.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-07T08:36:33+00:00
Next Scan 2024-06-06T08:36:33+00:00

Last Successful Scan

Scanned2024-01-16T08:35:22+00:00
URL https://smokeday.com/robots.txt
Domain IPs 104.26.0.140, 104.26.1.140, 172.67.72.212
Response IP 104.26.1.140
Found Yes
Hash 888d748d5fe83b0332b1d28a491ea707b38449cb1d3364b9e06289c1467ce726
SimHash 4904dec6c8a2

Groups

*

Rule Path
Disallow /*?
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /admin/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /review/product/
Disallow /sendfriend/
Disallow /enable-cookies/
Disallow /LICENSE.txt
Disallow /LICENSE.html
Disallow /sales/guest/form/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /final-clearance-items.html/
Disallow /*?order
Disallow /*?order*
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/

Other Records

Field Value
sitemap https://www.smokeday.com/sitemap.xml

Comments

  • Google Image Crawler Setup
  • User-agent: Googlebot-Image