Log In Sign Up

тунио.рф
robots.txt

Robots Exclusion Standard data for тунио.рф

Resource Scan

Scan Details

Site Domain тунио.рф
Base Domain тунио.рф
Scan Status Ok
Last Scan2025-12-01T15:54:49+00:00
Next Scan 2025-12-08T15:54:49+00:00

Last Scan

Scanned2025-12-01T15:54:49+00:00
URL https://тунио.рф/robots.txt
Redirect https://toonio.ru/robots.txt
Redirect Domain toonio.ru
Redirect Base toonio.ru
Domain IPs 104.21.40.183, 172.67.156.72, 2606:4700:3033::6815:28b7, 2606:4700:3035::ac43:9c48
Redirect IPs 82.146.36.182
Response IP 82.146.36.182
Found Yes
Hash 4740253b276aeab4fe7ac0bd05106783623dceadccf2203e604b8bc3d7ec286d
SimHash 76945b04c7e2

Groups

*

Rule Path
Disallow /draw/edit
Disallow /draw/continue
Disallow /web
Disallow /editor
Disallow /player
Disallow /restore
Disallow /confirm
Disallow /search
Disallow /test
Disallow /promote

gptbot
claudebot
claude-web
ccbot
google-extended
applebot-extended
facebookbot
meta-externalagent
meta-externalfetcher
diffbot
perplexitybot
omgili
omgilibot
webzio-extended
imagesiftbot
bytespider
amazonbot
youbot
semrushbot-ocob
petalbot
velenpublicwebcrawler
turnitinbot
timpibot
oai-searchbot
icc-crawler
ai2bot
ai2bot-dolma
dataforseobot
awariobot
awariosmartbot
awariorssbot
google-cloudvertexbot
pangubot
kangaroo bot
sentibot
img2dataset
meltwater
seekr
peer39_crawler
cohere-ai
cohere-training-data-crawler
duckassistbot
scrapy

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Back to top

Comments

  • Block all known AI crawlers and assistants
  • from using content for training AI models.
  • Source: https://robotstxt.com/ai
  • Block any non-specified AI crawlers (e.g., new
  • or unknown bots) from using content for training
  • AI models. This directive is still experimental
  • and may not be supported by all AI crawlers.
Back to top

Warnings

  • `clean-param` is not a known field.
  • `disallowaitraining` is not a known field.
Back to top