smartdeconline.com
robots.txt

Robots Exclusion Standard data for smartdeconline.com

Resource Scan

Scan Details

Site Domain smartdeconline.com
Base Domain smartdeconline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-13T12:56:21+00:00
Next Scan 2025-11-11T12:56:21+00:00

Last Successful Scan

Scanned2023-09-30T15:14:53+00:00
URL https://smartdeconline.com/robots.txt
Redirect https://www.smartdeconline.com/robots.txt
Redirect Domain www.smartdeconline.com
Redirect Base smartdeconline.com
Domain IPs 172.65.227.72
Redirect IPs 104.18.232.42, 104.18.233.42, 2606:4700::6812:e82a, 2606:4700::6812:e92a
Response IP 104.18.232.42
Found Yes
Hash 590ed0322a9b2421d04709eea92823284161d6b13f8c16f86f32f0427fdf5227
SimHash 2d005f2a5881

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*
Disallow /cdn-cgi
Disallow /api/bundle-popups
Disallow /api/bundle-sales
Disallow /api/bundle-sales/global-text
Disallow /api/cart/*
Disallow /api/comment-config
Disallow /api/comment/*
Disallow /api/discount-code/coupons
Disallow /api/monkey-i18n
Disallow /api/multi-currency/finance-list
Disallow /api/popups
Disallow /api/preload-checkout
Disallow /api/recommend-app/rule/query

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*
Disallow /cdn-cgi

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.smartdeconline.com/sitemap.xml.gz
sitemap https://www.smartdeconline.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!