topspink.com
robots.txt

Robots Exclusion Standard data for topspink.com

Resource Scan

Scan Details

Site Domain topspink.com
Base Domain topspink.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-03T01:52:45+00:00
Next Scan 2025-11-01T01:52:45+00:00

Last Successful Scan

Scanned2023-09-20T23:59:53+00:00
URL https://topspink.com/robots.txt
Redirect https://www.topspink.com/robots.txt
Redirect Domain www.topspink.com
Redirect Base topspink.com
Domain IPs 172.65.227.72
Redirect IPs 104.18.232.42, 104.18.233.42, 2606:4700::6812:e82a, 2606:4700::6812:e92a
Response IP 104.18.233.42
Found Yes
Hash 51f22e9bfd10f6d7788a5082dbd94304aaa1486c109ccd9681a226e9aa69a062
SimHash 0d105f6a5981

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*
Disallow /cdn-cgi
Disallow /api/bundle-popups
Disallow /api/bundle-sales
Disallow /api/bundle-sales/global-text
Disallow /api/cart/*
Disallow /api/comment-config
Disallow /api/comment/*
Disallow /api/discount-code/coupons
Disallow /api/monkey-i18n
Disallow /api/multi-currency/finance-list
Disallow /api/popups
Disallow /api/preload-checkout
Disallow /api/recommend-app/rule/query

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*
Disallow /cdn-cgi

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.topspink.com/sitemap.xml.gz
sitemap https://www.topspink.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!