caiming.cc
robots.txt

Robots Exclusion Standard data for caiming.cc

Resource Scan

Scan Details

Site Domain caiming.cc
Base Domain caiming.cc
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-12T15:59:02+00:00
Next Scan 2026-03-12T15:59:02+00:00

Last Successful Scan

Scanned2022-10-05T16:05:48+00:00
URL https://caiming.cc/robots.txt
Redirect https://www.caiming.cc/robots.txt
Redirect Domain www.caiming.cc
Redirect Base caiming.cc
Response IP 104.21.49.229, 172.67.195.91
Found Yes
Hash d998e1b0fafe73b30df18f1ac73ee4fdd43e1ca844c56ae41d17ef3eb99e261b
SimHash cb16d550e282

Groups

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /about
Disallow /about*
Disallow /about/
Disallow /archive
Disallow /archive*
Disallow /archive/
Disallow /image
Disallow /image*
Disallow /image/
Disallow /mobile
Disallow /mobile*
Disallow /mobile/
Disallow /page
Disallow /page*
Disallow /page/
Disallow /post
Disallow /post*
Disallow /post/
Disallow /search
Disallow /search*
Disallow /search/
Disallow /tagged
Disallow /tagged*
Disallow /tagged/
Disallow /?s=
Disallow /?s=*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://www.caiming.cc/sitemap.xml