emptywheel.net
robots.txt

Robots Exclusion Standard data for emptywheel.net

Resource Scan

Scan Details

Site Domain emptywheel.net
Base Domain emptywheel.net
Scan Status Ok
Last Scan2025-08-24T22:15:48+00:00
Next Scan 2025-09-23T22:15:48+00:00

Last Scan

Scanned2025-08-24T22:15:48+00:00
URL https://emptywheel.net/robots.txt
Domain IPs 172.66.133.115, 172.66.136.189, 2606:4700:10::ac42:8573, 2606:4700:10::ac42:88bd
Response IP 172.66.136.189
Found Yes
Hash ff3004059603133278a06871c71e91bdc819921a20f399c6a19202a7c6627d8f
SimHash 6558dcd641b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20