Log In Sign Up

koreanrandom.com
robots.txt

Robots Exclusion Standard data for koreanrandom.com

Resource Scan

Scan Details

Site Domain koreanrandom.com
Base Domain koreanrandom.com
Scan Status Ok
Last Scan2025-11-02T18:10:27+00:00
Next Scan 2025-11-09T18:10:27+00:00

Last Scan

Scanned2025-11-02T18:10:27+00:00
URL https://koreanrandom.com/robots.txt
Domain IPs 104.21.15.220, 172.67.207.226, 2606:4700:3031::ac43:cfe2, 2606:4700:3037::6815:fdc
Response IP 104.21.15.220
Found Yes
Hash 286246beae5bf3559d12b66b2b88672f6728af810235d9d6723bbf08b38005ca
SimHash 1014d153c88a

Groups

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindexbot

Rule Path
Disallow /

seo-powersuite-bot

Rule Path
Disallow /

*

Rule Path
Disallow *do%3Dembed*
Disallow *attachment.php*
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=
Disallow /*?do=
Disallow /*ref%3D
Disallow /*?forumId*
Disallow /*?&controller=embed
Back to top

Comments

  • Alexa: https://support.alexa.com/hc/en-us/articles/200450194-Alexa-s-Web-and-Site-Audit-Crawlers
  • Ahrefs: https://ahrefs.com/robot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/rogerbot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/dotbot
  • DataForSeo https://dataforseo.com/dataforseo-bot
  • Semrush: https://www.semrush.com/bot/
  • Majestic: https://mj12bot.com/
  • SerpStat: https://serpstatbot.com/
  • MegaIndex: https://ru.megaindex.com/blog/seo-bot-detection
  • SEO-PowerSuite-bot: https://www.link-assistant.com/seo-workflow/site-audit.html
  • Block faceted pages and 301 redirect pages
Back to top