darwinsdata.com
robots.txt

Robots Exclusion Standard data for darwinsdata.com

Resource Scan

Scan Details

Site Domain darwinsdata.com
Base Domain darwinsdata.com
Scan Status Ok
Last Scan2025-12-03T07:36:14+00:00
Next Scan 2025-12-10T07:36:14+00:00

Last Scan

Scanned2025-12-03T07:36:14+00:00
URL https://darwinsdata.com/robots.txt
Domain IPs 104.21.73.206, 172.67.192.38, 2606:4700:3035::6815:49ce, 2606:4700:3037::ac43:c026
Response IP 104.21.73.206
Found Yes
Hash 5a058b1af12f50e80d15b0d7aa51f25c3be06064e539df5159428c726fc09bbc
SimHash 6100d840c992

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://darwinsdata.com/sitemap_index.xml