floodgap.com
robots.txt

Robots Exclusion Standard data for floodgap.com

Resource Scan

Scan Details

Site Domain floodgap.com
Base Domain floodgap.com
Scan Status Ok
Last Scan2025-08-13T17:04:43+00:00
Next Scan 2025-09-12T17:04:43+00:00

Last Scan

Scanned2025-08-13T17:04:43+00:00
URL https://www.floodgap.com/robots.txt
Domain IPs 192.80.49.34
Response IP 192.80.49.34
Found Yes
Hash 56e2011bab94a553c4c8a7f4b6824fd7bf20caa264143e8eb6a1373d7e7231a0
SimHash 3e50c58ada87

Groups

*

Rule Path
Disallow /iv/
Disallow /iv/*
Disallow /iv-store/
Disallow /iv-store/*

claudebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

psbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

google keyword tool

Rule Path
Disallow /

google-keyword-tool

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-image/1.0

Rule Path
Disallow /

msnbot

Rule Path
Disallow /*.jpg$
Disallow /*.gif$
Disallow /*.JPG$
Disallow /*.zip$
Disallow /*.lzh$
Disallow /*.d64$
Disallow /*.lha$
Disallow /*.prg$
Disallow /*.gz$

yahoo-mmcrawler

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

msrbot

Rule Path
Disallow /

*

Rule Path
Disallow /retrobits/ckb/display.cgi
Disallow /retrobits/ckb/display.cgi?*
Disallow /retrobits/ckb/ckb-topic.cgi
Disallow /retrobits/ckb/ckb-topic.cgi?*
Disallow /retrobits/ckb/ckb.cgi
Disallow /retrobits/ckb/ckb.cgi?*
Disallow /retrobits/ckb/ckb-age.cgi
Disallow /retrobits/ckb/ckb-age.cgi?*
Disallow /retrobits/ckb/cprog.cgi
Disallow /retrobits/ckb/cprog.cgi?*
Disallow /*.jpg$
Disallow /*.gif$
Disallow /*.JPG$
Disallow /*.zip$
Disallow /*.lzh$
Disallow /*.d64$
Disallow /*.lha$
Disallow /*.prg$
Disallow /*.gz$

hatenascreenshot

Rule Path
Disallow /

ptd-crawler

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

gptbot

Rule Path
Disallow /