mechwarrior3.org
robots.txt

Robots Exclusion Standard data for mechwarrior3.org

Resource Scan

Scan Details

Site Domain mechwarrior3.org
Base Domain mechwarrior3.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-08T01:08:46+00:00
Next Scan 2026-01-07T01:08:46+00:00

Last Successful Scan

Scanned2025-08-16T17:08:39+00:00
URL https://mechwarrior3.org/robots.txt
Domain IPs 104.21.91.143, 172.67.222.22, 2606:4700:3031::6815:5b8f, 2606:4700:3034::ac43:de16
Response IP 172.67.222.22
Found Yes
Hash aba682714abeef9dff45f5e437c1c5bf2b0e337b3dd5693a92e4996b5a4bbed9
SimHash 0034d752755b

Groups

googlebot

Rule Path
Allow /

exabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

googlebot-image

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /