vexrobotics.com
robots.txt

Robots Exclusion Standard data for vexrobotics.com

Resource Scan

Scan Details

Site Domain vexrobotics.com
Base Domain vexrobotics.com
Scan Status Ok
Last Scan2025-09-28T23:18:05+00:00
Next Scan 2025-10-28T23:18:05+00:00

Last Scan

Scanned2025-09-28T23:18:05+00:00
URL https://vexrobotics.com/robots.txt
Redirect https://www.vexrobotics.com/robots.txt?___store=vexroboticsap&___from_store=vexrobotics
Redirect Domain www.vexrobotics.com
Redirect Base vexrobotics.com
Domain IPs 104.18.41.207, 172.64.146.49, 2606:4700:4408::ac40:9231, 2a06:98c1:310a::6812:29cf
Redirect IPs 104.18.41.207, 172.64.146.49, 2606:4700:4408::ac40:9231, 2a06:98c1:310a::6812:29cf
Response IP 172.64.146.49
Found Yes
Hash 051a172c8e6a712715ffed580e277553c402b3dc7f233a0420274d584b3f33de
SimHash e129dd4bca51

Groups

*

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /teach-primary
Disallow /*SID%3D
Disallow /go-kit-contents
Disallow /productalert/
Disallow /276-7505.html

Other Records

Field Value
sitemap https://www.vexrobotics.com/media/sitemap/vexrobotics_sitemap.xml