simpfit.com
robots.txt

Robots Exclusion Standard data for simpfit.com

Resource Scan

Scan Details

Site Domain simpfit.com
Base Domain simpfit.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-13T09:02:51+00:00
Next Scan 2025-11-11T09:02:51+00:00

Last Successful Scan

Scanned2024-03-29T03:02:18+00:00
URL https://simpfit.com/robots.txt
Redirect https://www.simpfit.com/robots.txt
Redirect Domain www.simpfit.com
Redirect Base simpfit.com
Domain IPs 103.172.191.1
Redirect IPs 104.18.232.42, 104.18.233.42, 2606:4700::6812:e82a, 2606:4700::6812:e92a
Response IP 104.18.233.42
Found Yes
Hash 6e995ccf8d49638170c49d5a49d12947b5bfb169cc10540883d8ca321d112ed2
SimHash 25205f2a1981

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*
Disallow /cdn-cgi
Disallow /api/bundle-popups
Disallow /api/bundle-sales
Disallow /api/bundle-sales/global-text
Disallow /api/cart/*
Disallow /api/comment-config
Disallow /api/comment/*
Disallow /api/discount-code/coupons
Disallow /api/monkey-i18n
Disallow /api/multi-currency/finance-list
Disallow /api/popups
Disallow /api/preload-checkout
Disallow /api/recommend-app/rule/query

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*
Disallow /cdn-cgi

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.simpfit.com/sitemap.xml.gz
sitemap https://www.simpfit.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!