xiamatrix.com
robots.txt

Robots Exclusion Standard data for xiamatrix.com

Resource Scan

Scan Details

Site Domain xiamatrix.com
Base Domain xiamatrix.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-08-26T07:17:06+00:00
Next Scan 2025-10-25T07:17:06+00:00

Last Successful Scan

Scanned2025-06-04T14:46:11+00:00
URL https://xiamatrix.com/robots.txt
Domain IPs 104.21.40.211, 172.67.188.96, 2606:4700:3030::ac43:bc60, 2606:4700:3031::6815:28d3
Response IP 104.21.40.211
Found Yes
Hash 4ccabf32b23539b8012dd54fdff1f2131d6f2f59d905abb01a9e7262015c9053
SimHash 6d15de537341

Groups

*

Rule Path
Disallow /admin
Disallow /auth
Disallow /auth/login
Disallow /cart
Disallow /checkout
Disallow /order
Disallow /order/*
Disallow /post-purchase
Disallow /post-purchase/*
Disallow /search
Disallow /policies

adsbot-google

Rule Path
Allow /
Disallow /cart
Disallow /checkouts
Disallow /orders

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /auth
Disallow /auth/login
Disallow /cart
Disallow /checkout
Disallow /order
Disallow /order/*
Disallow /post-purchase
Disallow /post-purchase/*
Disallow /search
Disallow /policies

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /auth
Disallow /auth/login
Disallow /cart
Disallow /checkout
Disallow /order
Disallow /order/*
Disallow /post-purchase
Disallow /post-purchase/*
Disallow /search
Disallow /policies

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /
Disallow

googlebot-image

Rule Path
Allow /
Disallow

Other Records

Field Value
sitemap https://xiamatrix.com/sitemap.xml
sitemap https://xiamatrix.com/sitemap.xml
sitemap https://xiamatrix.com/sitemap.xml

Comments

  • Google adsbot ignores robots.txt unless specifically named!