kiwisdr.com
robots.txt

Robots Exclusion Standard data for kiwisdr.com

Resource Scan

Scan Details

Site Domain kiwisdr.com
Base Domain kiwisdr.com
Scan Status Ok
Last Scan2024-10-09T01:39:12+00:00
Next Scan 2024-11-08T01:39:12+00:00

Last Scan

Scanned2024-10-09T01:39:12+00:00
URL http://kiwisdr.com/robots.txt
Domain IPs 50.116.2.70
Response IP 50.116.2.70
Found Yes
Hash d1afa395a158ea5b81e40f19ec655e6091711eebb943983215b2d27451e93768
SimHash a87ad862ca9b

Groups

*

Rule Path
Disallow /files/

Other Records

Field Value
crawl-delay 30

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

mauibot (crawler.feedback+dc@gmail.com)

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /