app.octomembers.com
robots.txt

Robots Exclusion Standard data for app.octomembers.com

Resource Scan

Scan Details

Site Domain app.octomembers.com
Base Domain octomembers.com
Scan Status Ok
Last Scan2025-10-18T06:16:57+00:00
Next Scan 2025-11-01T06:16:57+00:00

Last Scan

Scanned2025-10-18T06:16:57+00:00
URL https://app.octomembers.com/robots.txt
Domain IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.128.53
Found Yes
Hash 45b52c4c705d017422d941de6117a931a57fb79ba6fa82e9fc66f46ff038a25e
SimHash 32d4d460c9b3

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/15945046*
Disallow /spaces/15935508*
Disallow /spaces/5396732*
Disallow /spaces/12688543*
Disallow /spaces/14049393*
Disallow /spaces/12818653*
Disallow /spaces/1528207*
Disallow /spaces/2671092*
Disallow /spaces/11521170*
Disallow /spaces/16020647*
Disallow /spaces/11510304*
Disallow /spaces/6425596*
Disallow /spaces/13505876*
Disallow /spaces/11191295*
Disallow /spaces/13462036*
Disallow /spaces/1394765*
Disallow /spaces/5381014*
Disallow /spaces/2314233*
Disallow /communities/

Other Records

Field Value
sitemap https://app.octomembers.com/sitemap.xml