minerva.com
robots.txt

Robots Exclusion Standard data for minerva.com

Resource Scan

Scan Details

Site Domain minerva.com
Base Domain minerva.com
Scan Status Ok
Last Scan5/20/2025, 7:03:09 PM
Next Scan 5/27/2025, 7:03:09 PM

Last Scan

Scanned5/20/2025, 7:03:09 PM
URL https://minerva.com/robots.txt
Redirect https://www.minerva.com/robots.txt
Redirect Domain www.minerva.com
Redirect Base minerva.com
Domain IPs 104.21.79.134, 172.67.145.189, 2606:4700:3030::ac43:91bd, 2606:4700:3031::6815:4f86
Redirect IPs 104.21.79.134, 172.67.145.189, 2606:4700:3030::ac43:91bd, 2606:4700:3031::6815:4f86
Response IP 104.21.79.134
Found Yes
Hash 26de46066af010e838a20c4d884bbef4d4ed4e6b4be5b6a7a382131857c5154a
SimHash 6518dc44c195

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15