iprofiles.ru
robots.txt

Robots Exclusion Standard data for iprofiles.ru

Resource Scan

Scan Details

Site Domain iprofiles.ru
Base Domain iprofiles.ru
Scan Status Ok
Last Scan2026-04-06T11:43:37+00:00
Next Scan 2026-04-13T11:43:37+00:00

Last Scan

Scanned2026-04-06T11:43:37+00:00
URL https://iprofiles.ru/robots.txt
Domain IPs 65.21.92.92
Response IP 65.21.92.92
Found Yes
Hash ae16e6e460818c5244c8ef7abc69917f091ac85047597fe58b9d3ab1b66e40d5
SimHash 4190eb42e190

Groups

*

Rule Path
Disallow /*?
Disallow /cache
Disallow /compiled
Disallow /js/vendor/all.js
Disallow /js/app/app.js
Disallow /js/vendor/maps/*

gptbot
claudebot
claude-searchbot
ccbot
google-extended
applebot-extended
applebot
bytespider
imagesiftbot
meta-externalagent
meta-externalagent/1.1
perplexitybot
cohere-ai

Rule Path
Disallow /

Comments

  • === Блокировка известных AI-краулеров ===

Warnings

  • `disallowaitraining` is not a known field.
  • `host` is not a known field.