daringfireball.net
robots.txt

Robots Exclusion Standard data for daringfireball.net

Resource Scan

Scan Details

Site Domain daringfireball.net
Base Domain daringfireball.net
Scan Status Ok
Last Scan2024-06-01T20:33:09+00:00
Next Scan 2024-07-01T20:33:09+00:00

Last Scan

Scanned2024-06-01T20:33:09+00:00
URL https://daringfireball.net/robots.txt
Domain IPs 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80
Response IP 104.26.4.133
Found Yes
Hash eef7bb5cce20e2bd5971ccd96461d3a32617e3316fd177617b1da9d2e08c716e
SimHash 0044d840e153

Groups

*

Rule Path
Disallow /referrers/

gptbot

Rule Path
Disallow /