c168d.com
robots.txt

Robots Exclusion Standard data for c168d.com

Resource Scan

Scan Details

Site Domain c168d.com
Base Domain c168d.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-04-01T10:07:39+00:00
Next Scan 2026-04-15T10:07:39+00:00

Last Successful Scan

Scanned2026-03-10T03:32:44+00:00
URL https://c168d.com/robots.txt
Domain IPs 2600:9000:2721:1200:19:8dfa:1fc0:93a1, 2600:9000:2721:1800:19:8dfa:1fc0:93a1, 2600:9000:2721:1c00:19:8dfa:1fc0:93a1, 2600:9000:2721:5000:19:8dfa:1fc0:93a1, 2600:9000:2721:7000:19:8dfa:1fc0:93a1, 2600:9000:2721:7800:19:8dfa:1fc0:93a1, 2600:9000:2721:b200:19:8dfa:1fc0:93a1, 2600:9000:2721:fe00:19:8dfa:1fc0:93a1, 3.165.102.109, 3.165.102.121, 3.165.102.4, 3.165.102.66
Response IP 3.165.102.121
Found Yes
Hash 0e975ac8edd92d8211b85d7629f737cf37239d62b7368c08b97c633588c0b8dc
SimHash 551ccb54e6f1

Groups

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

adsense

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

apis-google

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

google-notebooklm

Rule Path
Allow /

*

Rule Path
Disallow /