dune.com
robots.txt

Robots Exclusion Standard data for dune.com

Resource Scan

Scan Details

Site Domain dune.com
Base Domain dune.com
Scan Status Ok
Last Scan2024-05-15T12:38:35+00:00
Next Scan 2024-06-14T12:38:35+00:00

Last Scan

Scanned2024-05-15T12:38:35+00:00
URL https://dune.com/robots.txt
Domain IPs 104.22.20.153, 104.22.21.153, 172.67.31.94, 2606:4700:10::6816:1499, 2606:4700:10::6816:1599, 2606:4700:10::ac43:1f5e
Response IP 104.22.20.153
Found Yes
Hash dba5ae3370b949264ac8956f24ae7d90285a510466f04298f8d098f1c52ded6b
SimHash 4144d860c313

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /