polination.ru
robots.txt

Robots Exclusion Standard data for polination.ru

Resource Scan

Scan Details

Site Domain polination.ru
Base Domain polination.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-02-07T23:32:33+00:00
Next Scan 2026-05-08T23:32:33+00:00

Last Successful Scan

Scanned2025-09-07T03:53:28+00:00
URL https://polination.ru/robots.txt
Domain IPs 104.21.68.234, 172.67.199.134, 2606:4700:3035::6815:44ea, 2606:4700:3035::ac43:c786
Response IP 172.67.199.134
Found Yes
Hash bf98b969b382f48bdf1e29fd11a2721a990afd99c790ff55c180bc4fe0e39c74
SimHash 77d44b01c2c4

Groups

ai2bot
ai2bot-dolma
aihitbot
amazonbot
anthropic-ai
applebot
applebot-extended
brightbot 1.0
bytespider
ccbot
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
cotoyogi
crawlspace
diffbot
duckassistbot
facebookbot
factset_spyderbot
firecrawlagent
friendlycrawler
google-cloudvertexbot
google-extended
googleother
googleother-image
googleother-video
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
imgproxy
isscyberriskcrawler
kangaroo bot
meta-externalagent
meta-externalagent
meta-externalfetcher
meta-externalfetcher
mistralai-user/1.0
novaact
oai-searchbot
omgili
omgilibot
operator
pangubot
perplexity-user
perplexitybot
petalbot
qualifiedbot
scrapy
semrushbot-ocob
semrushbot-swa
sidetrade indexer bot
tiktokspider
timpibot
velenpublicwebcrawler
webzio-extended
wpbot
youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://polination.ru/sitemap.xml