community.aspentech.com
robots.txt

Robots Exclusion Standard data for community.aspentech.com

Resource Scan

Scan Details

Site Domain community.aspentech.com
Base Domain aspentech.com
Scan Status Ok
Last Scan2025-09-20T05:15:10+00:00
Next Scan 2025-10-04T05:15:10+00:00

Last Scan

Scanned2025-09-20T05:15:10+00:00
URL https://community.aspentech.com/robots.txt
Domain IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.138.52
Found Yes
Hash 6b299d379c0f8c63a83492e8f4735ebc46566f0f9bfaae62502aa9d471b0da0e
SimHash bd08ba41b097

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/9061173*
Disallow /spaces/12706787*
Disallow /spaces/13441667*
Disallow /spaces/12299125*
Disallow /spaces/20695632*
Disallow /spaces/13415301*
Disallow /spaces/13610121*
Disallow /spaces/20082532*
Disallow /spaces/11685313*
Disallow /spaces/19886003*
Disallow /spaces/11116677*
Disallow /spaces/20291834*
Disallow /spaces/9058452*
Disallow /spaces/10896918*
Disallow /spaces/20055484*
Disallow /spaces/13407664*
Disallow /spaces/21124868*
Disallow /spaces/20936772*
Disallow /spaces/9159630*
Disallow /spaces/10886623*
Disallow /spaces/10857217*
Disallow /spaces/17885602*
Disallow /spaces/10763985*
Disallow /spaces/21280705*
Disallow /spaces/12652642*
Disallow /spaces/14216494*
Disallow /spaces/11946093*
Disallow /spaces/12652629*
Disallow /spaces/16152470*
Disallow /spaces/20348924*
Disallow /spaces/13938587*
Disallow /spaces/13441631*
Disallow /spaces/9145740*
Disallow /spaces/20248565*
Disallow /spaces/11551734*
Disallow /spaces/11535090*
Disallow /spaces/9058015*
Disallow /spaces/21254282*
Disallow /spaces/11171706*
Disallow /spaces/21254301*
Disallow /spaces/10792947*
Disallow /spaces/18895994*
Disallow /spaces/11192941*
Disallow /spaces/21142069*
Disallow /spaces/19694205*
Disallow /spaces/21254277*
Disallow /spaces/20605180*
Disallow /spaces/17929396*
Disallow /communities/

Other Records

Field Value
sitemap https://community.aspentech.com/sitemap.xml