links.giant.rocks
robots.txt
Robots Exclusion Standard data for links.giant.rocks
Resource Scan
Scan Details
| Site Domain | links.giant.rocks |
| Base Domain | giant.rocks |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-12-29T23:35:20+00:00 |
| Next Scan | 2026-03-29T23:35:20+00:00 |
Last Successful Scan
| Scanned | 2025-08-25T01:14:25+00:00 |
| URL | https://links.giant.rocks/robots.txt |
| Domain IPs | 24.144.120.18, 2604:a880:400:d0::205d:b001 |
| Response IP | 24.144.120.18 |
| Found | Yes |
| Hash | b3a816074f9cd11edfa3681f5b434f9cd3695e05c92fdea9f819317b495a996f |
| SimHash | 2453cb01c2c0 |
Groups
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
algolia crawler
applebot
applenewsbot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
bingbot
bingpreview
bublupbot
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebookcatalog
facebookexternalhit
facebot
feedly
findxbot
gooblog
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
microsoftpreview
mojeekbot
msnbot
msnbot-media
orangebot
pinterest
plukkie
qwantify
rambler
semanticscholarbot
seznambot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
twitterbot
whatsapp
yacybot
yandex
yandexmobilebot
yepbot
yeti
yioopbot
yoozbot
youdaobot
*
addsearchbot
ai2bot
ai2bot-dolma
aihitbot
amazonbot
andibot
anthropic-ai
applebot-extended
awario
bedrockbot
bigsur.ai
brightbot 1.0
bytespider
chatgpt agent
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cloudvertexbot
cohere-ai
cohere-training-data-crawler
cotoyogi
crawlspace
datenbank crawler
devin
diffbot
duckassistbot
echobot bot
echoboxbot
facebookbot
factset_spyderbot
firecrawlagent
friendlycrawler
gemini-deep-research
google-cloudvertexbot
google-extended
googleagent-mariner
googleother
googleother-image
googleother-video
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
linerbot
meta-externalagent
meta-externalagent
meta-externalfetcher
meta-externalfetcher
mistralai-user
mistralai-user/1.0
mycentralaiscraperbot
netestate imprint crawler
novaact
oai-searchbot
omgili
omgilibot
operator
pangubot
panscient
panscient.com
perplexity-user
perplexitybot
petalbot
phindbot
poseidon research crawler
qualifiedbot
quillbot
quillbot.com
sbintuitionsbot
scrapy
semrushbot-ocob
semrushbot-swa
sidetrade indexer bot
thinkbot
tiktokspider
timpibot
velenpublicwebcrawler
wardbot
webzio-extended
wpbot
yak
yandexadditional
yandexadditionalbot
youbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | / |
Warnings
- 3 invalid lines.
Comments