kpfk.org
robots.txt

Robots Exclusion Standard data for kpfk.org

Resource Scan

Scan Details

Site Domain kpfk.org
Base Domain kpfk.org
Scan Status Ok
Last Scan2024-06-22T15:12:04+00:00
Next Scan 2024-07-22T15:12:04+00:00

Last Scan

Scanned2024-06-22T15:12:04+00:00
URL https://kpfk.org/robots.txt
Redirect https://www.kpfk.org/robots.txt
Redirect Domain www.kpfk.org
Redirect Base kpfk.org
Domain IPs 34.250.153.99
Redirect IPs 108.139.10.116, 108.139.10.119, 108.139.10.17, 108.139.10.87
Response IP 18.165.171.78
Found Yes
Hash 038c7f0229e087e6583a726bdd658b88b85ac3311a59a8ffa6b1d04e6e8acb6b
SimHash 6d3c5454cc11

Groups

*

Rule Path
Disallow /_hp/
Disallow /artist/
Disallow /searchresults/

Other Records

Field Value
crawl-delay 8

Other Records

Field Value
sitemap https://www.kpfk.org/sitemap.xml