Log In Sign Up

darwins-theory-of-evolution.com
robots.txt

Robots Exclusion Standard data for darwins-theory-of-evolution.com

Resource Scan

Scan Details

Site Domain darwins-theory-of-evolution.com
Base Domain darwins-theory-of-evolution.com
Scan Status Ok
Last Scan2025-08-18T22:53:58+00:00
Next Scan 2025-09-17T22:53:58+00:00

Last Scan

Scanned2025-08-18T22:53:58+00:00
URL https://darwins-theory-of-evolution.com/robots.txt
Redirect https://www.darwins-theory-of-evolution.com/robots.txt
Redirect Domain www.darwins-theory-of-evolution.com
Redirect Base darwins-theory-of-evolution.com
Domain IPs 104.21.0.86, 172.67.223.172, 2606:4700:3030::6815:56, 2606:4700:3031::ac43:dfac
Redirect IPs 104.21.0.86, 172.67.223.172, 2606:4700:3030::6815:56, 2606:4700:3031::ac43:dfac
Response IP 172.67.223.172
Found Yes
Hash ebc7b008403de83a01d55c04284c0f1e2868c062d3401ba4367415c7577babe0
SimHash 0305c4444d93

Groups

ia_archiver

Rule Path
Allow *

archive.org_bot

Rule Path
Allow *

*

Rule Path
Disallow */common/*
Disallow */images/*
Disallow */000.*
Back to top

Other Records

Field Value
sitemap https://www.darwins-theory-of-evolution.com/sitemap.xml
Back to top

Comments

  • archive.org/post/234741/robotstxt
  • - - - - - - -
  • common
  • - - - - - - -
  • test: technicalseo.com/tools/robots-txt/
Back to top