Log In Sign Up

jitnetwork.org
robots.txt

Robots Exclusion Standard data for jitnetwork.org

Resource Scan

Scan Details

Site Domain jitnetwork.org
Base Domain jitnetwork.org
Scan Status Ok
Last Scan2025-09-23T19:59:01+00:00
Next Scan 2025-10-07T19:59:01+00:00

Last Scan

Scanned2025-09-23T19:59:01+00:00
URL https://jitnetwork.org/robots.txt
Domain IPs 147.185.161.77, 147.185.161.78
Response IP 147.185.161.77
Found Yes
Hash 9668277607742c6ff4d90262f8471fee0f60ba1b157120fc639cdc33c784a5dd
SimHash 7894fb03e198

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/17426582*
Disallow /spaces/11843738*
Disallow /spaces/8361652*
Disallow /spaces/18845126*
Disallow /spaces/12007846*
Disallow /spaces/11611358*
Disallow /spaces/12261696*
Disallow /spaces/16639305*
Disallow /spaces/17246220*
Disallow /spaces/12350412*
Disallow /spaces/11809542*
Disallow /spaces/8806483*
Disallow /spaces/14594476*
Disallow /spaces/17426571*
Disallow /spaces/16497204*
Disallow /spaces/16013684*
Disallow /spaces/10824707*
Disallow /spaces/13960776*
Disallow /spaces/11673115*
Disallow /spaces/13667054*
Disallow /spaces/14013678*
Disallow /spaces/11674750*
Disallow /spaces/12962289*
Disallow /spaces/10506323*
Disallow /spaces/9107848*
Disallow /spaces/13861242*
Disallow /spaces/12284539*
Disallow /spaces/12911292*
Disallow /spaces/8363512*
Disallow /spaces/19224727*
Disallow /spaces/8202362*
Disallow /spaces/10132839*
Disallow /spaces/17848246*
Disallow /spaces/8260280*
Disallow /spaces/18641635*
Disallow /spaces/11258732*
Disallow /spaces/11524372*
Disallow /communities/
Back to top

Other Records

Field Value
sitemap https://jitnetwork.org/sitemap.xml
Back to top