xray-disk.com
robots.txt

Robots Exclusion Standard data for xray-disk.com

Resource Scan

Scan Details

Site Domain xray-disk.com
Base Domain xray-disk.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-06T18:43:13+00:00
Next Scan 2025-11-04T18:43:13+00:00

Last Successful Scan

Scanned2024-03-22T17:04:23+00:00
URL https://xray-disk.com/robots.txt
Redirect https://www.xray-disk.com/robots.txt
Redirect Domain www.xray-disk.com
Redirect Base xray-disk.com
Domain IPs 172.65.227.72
Redirect IPs 104.18.232.42, 104.18.233.42, 2606:4700::6812:e82a, 2606:4700::6812:e92a
Response IP 104.18.232.42
Found Yes
Hash a46854a821e26a5aa4fd28b67cf7ba0c2067d6988c5d3988a767475a7a703a1b
SimHash 2d205f2a1983

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*
Disallow /cdn-cgi
Disallow /api/bundle-popups
Disallow /api/bundle-sales
Disallow /api/bundle-sales/global-text
Disallow /api/cart/*
Disallow /api/comment-config
Disallow /api/comment/*
Disallow /api/discount-code/coupons
Disallow /api/monkey-i18n
Disallow /api/multi-currency/finance-list
Disallow /api/popups
Disallow /api/preload-checkout
Disallow /api/recommend-app/rule/query

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*
Disallow /cdn-cgi

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.worthysc.com/sitemap.xml.gz
sitemap https://www.worthysc.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!