rationalwiki.com
robots.txt

Robots Exclusion Standard data for rationalwiki.com

Resource Scan

Scan Details

Site Domain rationalwiki.com
Base Domain rationalwiki.com
Scan Status Ok
Last Scan2025-06-26T21:58:04+00:00
Next Scan 2025-07-26T21:58:04+00:00

Last Scan

Scanned2025-06-26T21:58:04+00:00
URL https://rationalwiki.com/robots.txt
Redirect https://rationalwiki.org/robots.txt
Redirect Domain rationalwiki.org
Redirect Base rationalwiki.org
Domain IPs 198.74.57.109
Redirect IPs 198.74.57.109, 2600:3c03::f03c:92ff:fe4e:4495
Response IP 198.74.57.109
Found Yes
Hash 96507ffbdd2c5ce6e5fc2cfae3899e1ac4e98e15b9d1201228c15f08b6bdb404
SimHash 1a1483d3c3c1

Groups

*

Rule Path
Allow /w/load.php?
Disallow /w/
Disallow /wiki/Special%3ARecentChangesLinked/
Disallow /wiki/Special%3AWhatLinksHere/

ia_archiver

Rule Path
Allow /*%26action%3Draw

apache-httpclient

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

Comments

  • robots.txt for http://rationalwiki.com/
  • Allow Internet Archive to index action=raw and store pages' raw wikitext