c6kk.sbs
robots.txt

Robots Exclusion Standard data for c6kk.sbs

Resource Scan

Scan Details

Site Domain c6kk.sbs
Base Domain c6kk.sbs
Scan Status Ok
Last Scan2024-10-26T10:22:53+00:00
Next Scan 2024-11-25T10:22:53+00:00

Last Scan

Scanned2024-10-26T10:22:53+00:00
URL https://c6kk.sbs/robots.txt
Domain IPs 104.21.70.63, 172.67.220.171, 2606:4700:3033::6815:463f, 2606:4700:3035::ac43:dcab
Response IP 104.21.70.63
Found Yes
Hash 5991eb86933b41193819867f5def9af03046817647574ff18514b2e8e05dbd75
SimHash e64dd140cc90

Groups

*

Rule Path
Disallow /page_related/
Disallow /post_hot/
Disallow /videos/post_hot/
Disallow /ja/videos/post_hot/
Disallow /zh-cn/videos/post_hot/
Disallow /en/videos/post_hot/
Disallow /zh-cn/page_related/
Disallow /zh-cn/post_hot/
Disallow /ja/page_related/
Disallow /ja/post_hot/
Disallow /en/page_related/
Disallow /en/post_hot/
Disallow /fanhao/recommentrandom/
Disallow /zh-cn/fanhao/recommentrandom/
Disallow /ja/fanhao/recommentrandom/
Disallow /en/fanhao/recommentrandom/
Disallow /ja/videos/post_hot/
Disallow /en/videos/post_hot/
Disallow /zh-cn/videos/post_hot/
Disallow /ja/videos/detailpart/
Disallow /en/videos/detailpart/
Disallow /zh-cn/videos/detailpart/
Disallow /ja/videos/list/
Disallow /en/videos/list/
Disallow /zh-cn/videos/list/
Disallow /ja/casts/castspart/
Disallow /en/casts/castspart/
Disallow /zh-cn/casts/castspart/
Disallow /ja/vidoes8/
Disallow /en/vidoes8/
Disallow /zh-cn/vidoes8/
Disallow /cdn-cgi/

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /