collectionb.cc
robots.txt
Robots Exclusion Standard data for collectionb.cc
Resource Scan
Scan Details
Site Domain | collectionb.cc |
Base Domain | collectionb.cc |
Scan Status | Ok |
Last Scan | 2025-05-19T06:12:57+00:00 |
Next Scan | 2025-06-18T06:12:57+00:00 |
Last Scan
Scanned | 2025-05-19T06:12:57+00:00 |
URL | https://collectionb.cc/robots.txt |
Domain IPs | 133.186.222.65 |
Response IP | 133.186.222.65 |
Found | Yes |
Hash | 6f23a64e955d9391fb63938483430a3e3eb39fa75345dd94a269a3ce55cf8687 |
SimHash | a0569683c4c6 |
Groups
facebookexternalhit
dotbot
screaming frog seo spide
heritrix
bingbot
owasp
geofeed
dirbuster-1.0-rc1
pfinapp
droid build
googlebot
cowbot
naverbot
yeti
daumoa
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /config/ |
Disallow | /module/ |
Disallow | /tmp/ |
Disallow | /service/ |
Disallow | /board/ |
Disallow | /mypage/ |
Disallow | /data/add_goods/ |
Disallow | /data/assets/ |
Disallow | /data/attendance/ |
Disallow | /data/board/ |
Disallow | /data/category/ |
Disallow | /data/commonimg/ |
Disallow | /data/conf |
Disallow | /data/coupon_image/ |
Disallow | /data/crema/ |
Disallow | /data/dburl/ |
Disallow | /data/editor/ |
Disallow | /data/etc/ |
Disallow | /data/excel/ |
Disallow | /data/facebookFeed/ |
Disallow | /data/ghost_depositor/ |
Disallow | /data/gift/ |
Disallow | /data/icon/ |
Disallow | /data/log/ |
Disallow | /data/mail/ |
Disallow | /data/mobile/ |
Disallow | /data/module/ |
Disallow | /data/multi_popup/ |
Disallow | /data/pg_key/ |
Disallow | /data/poll/ |
Disallow | /data/scm/ |
Disallow | /data/skin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments