arena.tonyrobbins.com
robots.txt

Robots Exclusion Standard data for arena.tonyrobbins.com

Resource Scan

Scan Details

Site Domain arena.tonyrobbins.com
Base Domain tonyrobbins.com
Scan Status Ok
Last Scan2025-09-19T20:30:58+00:00
Next Scan 2025-10-03T20:30:58+00:00

Last Scan

Scanned2025-09-19T20:30:58+00:00
URL https://arena.tonyrobbins.com/robots.txt
Domain IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.128.53
Found Yes
Hash c6c40559609662918df995296d8fe3bb556c67e7faecf23faa2f244142481605
SimHash 3655c9738bb4

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/21276842*
Disallow /spaces/19762990*
Disallow /spaces/18527474*
Disallow /spaces/18527466*
Disallow /spaces/14251658*
Disallow /spaces/18860683*
Disallow /spaces/18527482*
Disallow /spaces/18447950*
Disallow /spaces/16569924*
Disallow /spaces/19111217*
Disallow /spaces/21195777*
Disallow /spaces/21135364*
Disallow /spaces/21135386*
Disallow /spaces/21135381*
Disallow /spaces/21135378*
Disallow /spaces/20074789*
Disallow /spaces/11521754*
Disallow /spaces/19111186*
Disallow /spaces/19187156*
Disallow /spaces/19111230*
Disallow /communities/

Other Records

Field Value
sitemap https://arena.tonyrobbins.com/sitemap.xml