collectionb.cc
robots.txt

Robots Exclusion Standard data for collectionb.cc

Resource Scan

Scan Details

Site Domain collectionb.cc
Base Domain collectionb.cc
Scan Status Ok
Last Scan2025-05-19T06:12:57+00:00
Next Scan 2025-06-18T06:12:57+00:00

Last Scan

Scanned2025-05-19T06:12:57+00:00
URL https://collectionb.cc/robots.txt
Domain IPs 133.186.222.65
Response IP 133.186.222.65
Found Yes
Hash 6f23a64e955d9391fb63938483430a3e3eb39fa75345dd94a269a3ce55cf8687
SimHash a0569683c4c6

Groups

mj12bot
semrushbot
claudebot
gptbot

Rule Path
Disallow /

facebookexternalhit
dotbot
screaming frog seo spide
heritrix
bingbot
owasp
geofeed
dirbuster-1.0-rc1
pfinapp
droid build
googlebot
cowbot
naverbot
yeti
daumoa

Rule Path
Disallow /admin/
Disallow /config/
Disallow /module/
Disallow /tmp/
Disallow /service/
Disallow /board/
Disallow /mypage/
Disallow /data/add_goods/
Disallow /data/assets/
Disallow /data/attendance/
Disallow /data/board/
Disallow /data/category/
Disallow /data/commonimg/
Disallow /data/conf
Disallow /data/coupon_image/
Disallow /data/crema/
Disallow /data/dburl/
Disallow /data/editor/
Disallow /data/etc/
Disallow /data/excel/
Disallow /data/facebookFeed/
Disallow /data/ghost_depositor/
Disallow /data/gift/
Disallow /data/icon/
Disallow /data/log/
Disallow /data/mail/
Disallow /data/mobile/
Disallow /data/module/
Disallow /data/multi_popup/
Disallow /data/pg_key/
Disallow /data/poll/
Disallow /data/scm/
Disallow /data/skin/

Other Records

Field Value
crawl-delay 10

Comments

  • Default Bot Policy List provided by GODOMALL