jkrowling.com
robots.txt

Robots Exclusion Standard data for jkrowling.com

Resource Scan

Scan Details

Site Domain jkrowling.com
Base Domain jkrowling.com
Scan Status Ok
Last Scan2025-09-14T17:34:46+00:00
Next Scan 2025-10-14T17:34:46+00:00

Last Scan

Scanned2025-09-14T17:34:46+00:00
URL https://jkrowling.com/robots.txt
Domain IPs 104.26.12.63, 104.26.13.63, 172.67.68.42, 2606:4700:20::681a:c3f, 2606:4700:20::681a:d3f, 2606:4700:20::ac43:442a
Response IP 172.67.68.42
Found Yes
Hash 3b9842361359dff64f234bb7dea5b2062751f0dbc6d6619b65130d8f6af9170f
SimHash 6008c8d2c7b1

Groups

scrapy

Rule Path
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30