darwinium.com
robots.txt

Robots Exclusion Standard data for darwinium.com

Resource Scan

Scan Details

Site Domain darwinium.com
Base Domain darwinium.com
Scan Status Ok
Last Scan2025-10-14T01:51:47+00:00
Next Scan 2025-11-13T01:51:47+00:00

Last Scan

Scanned2025-10-14T01:51:47+00:00
URL https://darwinium.com/robots.txt
Redirect https://www.darwinium.com/robots.txt
Redirect Domain www.darwinium.com
Redirect Base darwinium.com
Domain IPs 104.21.66.124, 172.67.159.232, 2606:4700:3033::ac43:9fe8, 2606:4700:3035::6815:427c
Redirect IPs 104.21.66.124, 172.67.159.232, 2606:4700:3033::ac43:9fe8, 2606:4700:3035::6815:427c
Response IP 104.21.66.124
Found Yes
Hash fd5bf1278d99e9823a1e77cbca60d83dfbc35c211ce65606b381b2b8b0f7abba
SimHash 4900de43c5b1

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /demo-blocks
Disallow /blog

Other Records

Field Value
sitemap https://darwinium.com/sitemap.xml

Comments

  • *
  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.