verticalox.com
robots.txt

Robots Exclusion Standard data for verticalox.com

Resource Scan

Scan Details

Site Domain verticalox.com
Base Domain verticalox.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-06T09:13:01+00:00
Next Scan 2025-11-04T09:13:01+00:00

Last Successful Scan

Scanned2023-03-26T05:47:24+00:00
URL https://verticalox.com/robots.txt
Redirect https://www.verticalox.com/robots.txt
Redirect Domain www.verticalox.com
Redirect Base verticalox.com
Domain IPs 172.65.227.72
Redirect IPs 104.18.128.14, 104.18.129.14, 2606:4700::6812:800e, 2606:4700::6812:810e
Response IP 104.18.128.14
Found Yes
Hash fb832f19f3b9114ecbbcb013b949b2c6039b100222d95a4100be1684cf99d8eb
SimHash 6d141d6a7181

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*
Disallow /cdn-cgi

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*
Disallow /cdn-cgi

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.verticalox.com/sitemap.xml.gz
sitemap https://www.verticalox.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!