22warriors.org
robots.txt

Robots Exclusion Standard data for 22warriors.org

Resource Scan

Scan Details

Site Domain 22warriors.org
Base Domain 22warriors.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-28T00:38:54+00:00
Next Scan 2026-01-26T00:38:54+00:00

Last Successful Scan

Scanned2025-03-09T23:14:09+00:00
URL https://22warriors.org/robots.txt
Domain IPs 104.21.28.32, 172.67.170.57, 2606:4700:3034::ac43:aa39, 2606:4700:3037::6815:1c20
Response IP 104.21.28.32
Found Yes
Hash f2b9b919933788c07e9042d96cd3113765bfd22615f245aeb707485b22d2c4cc
SimHash 0a15da30ee73

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /login
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://22warriors.org/sitemap.xml