it.justcnw.com
robots.txt

Robots Exclusion Standard data for it.justcnw.com

Resource Scan

Scan Details

Site Domain it.justcnw.com
Base Domain justcnw.com
Scan Status Ok
Last Scan2025-10-18T19:25:47+00:00
Next Scan 2025-11-17T19:25:47+00:00

Last Scan

Scanned2025-10-18T19:25:47+00:00
URL https://it.justcnw.com/robots.txt
Domain IPs 104.21.42.156, 172.67.206.149, 2606:4700:3034::ac43:ce95, 2606:4700:3035::6815:2a9c
Response IP 172.67.206.149
Found Yes
Hash fd3528a5bfc57a3c1253faab96a1acdb838bdd1096a363de28682056e52f953e
SimHash 0a8cc9a1ab33

Groups

*

Rule Path
Disallow /wp-admin/
Disallow *.xls$
Disallow *.xlsx$
Disallow *.xlsm$
Allow /wp-admin/admin-ajax.php
Disallow /*/page/1
Disallow /*/page/2
Disallow /*/page/3
Disallow /*/page/4
Disallow /*/page/5
Disallow /*/page/6
Disallow /*/page/7
Disallow /*/page/8
Disallow /*/page/9
Allow /*/page/1$
Allow /*/page/2$

gtpbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /