smoothl.com
robots.txt

Robots Exclusion Standard data for smoothl.com

Resource Scan

Scan Details

Site Domain smoothl.com
Base Domain smoothl.com
Scan Status Ok
Last Scan2025-09-16T21:43:01+00:00
Next Scan 2025-10-16T21:43:01+00:00

Last Scan

Scanned2025-09-16T21:43:01+00:00
URL https://smoothl.com/robots.txt
Domain IPs 52.10.27.176
Response IP 52.10.27.176
Found Yes
Hash c6ef57e72b04d56ea2b97fb98cbcd91b9b6f6b0a2b9a06d31bce38d96c09c8be
SimHash 6515de1271d4

Groups

*

Rule Path
Disallow /admin
Disallow /admin-2
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional
Disallow /password

adsbot-google

Rule Path
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /*theme_preview_id*
Disallow /checkout-additional

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value Comment
sitemap https://smoothl.com/sitemap.xml -
sitemap https://smoothl.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.
sitemap https://smoothl.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.

Comments

  • Google adsbot ignores robots.txt unless specifically named!