strategywiki.org
robots.txt

Robots Exclusion Standard data for strategywiki.org

Resource Scan

Scan Details

Site Domain strategywiki.org
Base Domain strategywiki.org
Scan Status Ok
Last Scan2025-12-30T22:17:04+00:00
Next Scan 2026-01-06T22:17:04+00:00

Last Scan

Scanned2025-12-30T22:17:04+00:00
URL https://strategywiki.org/robots.txt
Domain IPs 104.21.67.81, 172.67.218.168, 2606:4700:3030::ac43:daa8, 2606:4700:3037::6815:4351
Response IP 104.21.67.81
Found Yes
Hash 6a58da851a8d5ea12c02558d380918a57dd170260f51f0a57cad8747183a27e2
SimHash 585c990365d0

Groups

googlebot

Rule Path
Disallow /*title%3DSpecial%3ACreateAccount
Disallow /*title%3DCategory%3APages_using_DynamicPageList3_parser_function
Disallow /*title%3DCategory%3AArticles_with_invalid_or_missing_terms

mj12bot

Rule Path
Disallow /w/
Disallow /wiki/Special%3A

semrushbot

Rule Path
Disallow /w/
Disallow /wiki/Special%3A

amazonbot

Rule Path
Disallow /w/
Disallow /wiki/Special%3A

googleother

Rule Path
Disallow /w/
Disallow /wiki/Special%3A

oai-searchbot

Rule Path
Disallow /w/
Disallow /wiki/Special%3A

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-webindexer/1.1

Rule Path
Disallow /

*

Rule Path
Allow /w/load.php
Disallow /wiki/Help%3A
Disallow /wiki/Help_talk%3A
Disallow /wiki/MediaWiki%3A
Disallow /*title%3DSpecial%3ACreateAccount
Disallow /*title%3DCategory%3APages_using_DynamicPageList3_parser_function
Disallow /*title%3DCategory%3AArticles_with_invalid_or_missing_terms