Log In Sign Up

smokersoutletonline.com
robots.txt

Robots Exclusion Standard data for smokersoutletonline.com

Resource Scan

Scan Details

Site Domain smokersoutletonline.com
Base Domain smokersoutletonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-01T07:46:30+00:00
Next Scan 2026-05-02T07:46:30+00:00

Last Successful Scan

Scanned2025-08-23T18:30:03+00:00
URL https://smokersoutletonline.com/robots.txt
Domain IPs 172.66.40.181, 172.66.43.75, 2606:4700:3108::ac42:28b5, 2606:4700:3108::ac42:2b4b
Response IP 172.66.40.181
Found Yes
Hash e307d26e6f0aa9d04ccfdef3d37ed86d5ac1f5ef961aefaa729396697af1a992
SimHash 29085972c753

Groups

*

Rule Path
Disallow /index.php
Disallow /index.php/
Disallow /*?SID=
Disallow /checkout/*
Disallow /onestepcheckout/*
Disallow /customer/*
Disallow /customer/account/*
Disallow /customer/account/login/*
Disallow /catalogsearch/*
Disallow /catalog/product_compare/*
Disallow /catalog/category/view/*
Disallow /catalog/product/view/*
Disallow /wishlist/*
Disallow /productalert/*
Disallow /media/catalog/product/cache/*
Disallow /sendfriend/product/send/*
Disallow /*.html?*
Disallow /*/*.html?*
Disallow /*/*/*.html?*
Disallow /*?

googlebot-image

Rule Path
Allow

ahrefssiteaudit

Rule Path
Allow
Back to top

Other Records

Field Value
sitemap https://www.smokersoutletonline.com/pub/media/crawl/soo/sitemap.xml
Back to top

Comments

  • Do not crawl 2-nd home page copy
  • Do not crawl links with session IDs
  • Do not crawl checkout and user account pages
  • Do not crawl seach pages and not-SEO optimized catalog links
  • SOO-164
  • Updates to new URLS
  • Allow: /*.html?p=*
  • Allow: /*/*.html?p=*
  • Allow: /*/*/*.html?p=*
Back to top