kobotoolbox.org
robots.txt

Robots Exclusion Standard data for kobotoolbox.org

Resource Scan

Scan Details

Site Domain kobotoolbox.org
Base Domain kobotoolbox.org
Scan Status Ok
Last Scan2025-02-24T19:50:40+00:00
Next Scan 2025-03-26T19:50:40+00:00

Last Scan

Scanned2025-02-24T19:50:40+00:00
URL https://kobotoolbox.org/robots.txt
Redirect https://www.kobotoolbox.org/robots.txt
Redirect Domain www.kobotoolbox.org
Redirect Base kobotoolbox.org
Domain IPs 13.224.103.47, 13.224.103.61, 13.224.103.82, 13.224.103.96
Redirect IPs 18.238.85.105, 18.238.85.121, 18.238.85.38, 18.238.85.64
Response IP 52.85.49.98
Found Yes
Hash 2122f953bedd38b899850291cace4943e9167416213fb05e9380226a4cd04684
SimHash 70338333df60

Groups

*

Rule Path
Allow *

Other Records

Field Value
crawl-delay 1

backdoorbot/1.0

Rule Path
Disallow /

black hole

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

npbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

Comments

  • One day the AIs are going to look back on us the same way
  • we look at fossil skeletons on the plains of Africa.
  • -- Nathan, Ex Machina (2014)