Log In Sign Up

pinm.ru
robots.txt

Robots Exclusion Standard data for pinm.ru

Resource Scan

Scan Details

Site Domain pinm.ru
Base Domain pinm.ru
Scan Status Ok
Last Scan2024-10-07T21:22:04+00:00
Next Scan 2024-11-06T21:22:04+00:00

Last Scan

Scanned2024-10-07T21:22:04+00:00
URL https://pinm.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:4:294c, 2a00:15f8:a000:5:1:12:4:294c, 2a00:15f8:a000:5:1:13:4:294c, 2a00:15f8:a000:5:1:14:4:294c, 90.156.201.113, 90.156.201.35, 90.156.201.41, 90.156.201.42
Response IP 90.156.201.113
Found Yes
Hash 35be4967a973d6992c4d6cff2971a0a0e0fc811232a20d0a4f810f064d618a5a
SimHash 3216c553d98a

Groups

petalbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindexbot

Rule Path
Disallow /

seo-powersuite-bot

Rule Path
Disallow /

*
dotbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Comments

  • Alexa: https://support.alexa.com/hc/en-us/articles/200450194-Alexa-s-Web-and-Site-Audit-Crawlers
  • Ahrefs: https://ahrefs.com/robot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/rogerbot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/dotbot
  • DataForSeo https://dataforseo.com/dataforseo-bot
  • Semrush: https://www.semrush.com/bot/
  • Majestic: https://mj12bot.com/
  • SerpStat: https://serpstatbot.com/
  • MegaIndex: https://ru.megaindex.com/blog/seo-bot-detection
  • SEO-PowerSuite-bot: https://www.link-assistant.com/seo-workflow/site-audit.html
Back to top

Warnings

  • `host` is not a known field.
Back to top