haskell.org
robots.txt

Robots Exclusion Standard data for haskell.org

Resource Scan

Scan Details

Site Domain haskell.org
Base Domain haskell.org
Scan Status Ok
Last Scan2025-10-24T01:22:25+00:00
Next Scan 2025-11-23T01:22:25+00:00

Last Scan

Scanned2025-10-24T01:22:25+00:00
URL https://haskell.org/robots.txt
Redirect https://www.haskell.org/robots.txt
Redirect Domain www.haskell.org
Redirect Base haskell.org
Domain IPs 2001:4800:7817:104:be76:4eff:fe04:f608, 23.253.242.70
Redirect IPs 142.93.179.24
Response IP 142.93.179.24
Found Yes
Hash 9d3a84c6a5fb0f044f53d609314d50ae9b072b0b63d0198d34c6fa836a52fd52
SimHash ee3cd872e353

Groups

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /hoogle/?hoogle

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5