Log In Sign Up

7zip.dev
robots.txt

Robots Exclusion Standard data for 7zip.dev

Resource Scan

Scan Details

Site Domain 7zip.dev
Base Domain 7zip.dev
Scan Status Ok
Last Scan2025-07-18T07:55:14+00:00
Next Scan 2025-07-25T07:55:14+00:00

Last Scan

Scanned2025-07-18T07:55:14+00:00
URL https://7zip.dev/robots.txt
Domain IPs 104.21.41.69, 172.67.189.199, 2606:4700:3033::ac43:bdc7, 2606:4700:3036::6815:2945
Response IP 172.67.189.199
Found Yes
Hash 753ddd6ab81d58b558ea4677feb43713c1b8be20e8a59aefebf5240f1b4d3695
SimHash 3ad49fdacb4a

Groups

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindexbot

Rule Path
Disallow /

seo-powersuite-bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

seplinkbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

rankactivelinkbot

Rule Path
Disallow /

accuranker

Rule Path
Disallow /

siteanalyzerbot

Rule Path
Disallow /

similarweb

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://7zip.dev/sitemap_index.xml
Back to top

Comments

  • SOURCE AND UPDATES: https://akinix.com/forums/topic/163-how-to-block-ahrefs-semrush-serpstat-majestic-seo-megaindex-and-similar-bots-for-competitive-intelligence/
  • Alexa: https://support.alexa.com/hc/en-us/articles/200450194-Alexa-s-Web-and-Site-Audit-Crawlers
  • archive.org
  • Ahrefs: https://ahrefs.com/robot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/rogerbot
  • MOZ: https://moz.com/help/moz-procedures/crawlers/dotbot
  • DataForSeo https://dataforseo.com/dataforseo-bot
  • Semrush: https://www.semrush.com/bot/
  • Semrush bot for site audit
  • Semrush bot for brand monitoring
  • Semrush bot for site improvement
  • Semrush bot for site wide analysis
  • Semrush bot for content tracking
  • Semrush bot for backlink monitoring
  • SplitSignal bot, Semrush's tool for SEO testing
  • Majestic: https://mj12bot.com/
  • SerpStat: https://serpstatbot.com/
  • MegaIndex: https://ru.megaindex.com/blog/seo-bot-detection
  • SEO-PowerSuite-bot: https://www.link-assistant.com/seo-workflow/site-audit.html
  • OpenLinkProfiler bot for backlink analysis http://OpenLinkProfiler.org/bot
  • https://www.linkdex.com/
  • https://www.seozoom.it/bot/
  • seplinkbot bot for backlink analysis http://seplinkbot.com/
  • Linkpad bot for backlink analysis https://www.linkpad.ru
  • RankActive bot for rank tracking https://rankactive.com/resources/rankactive-linkbot
  • AccuRanker https://www.accuranker.com/
  • SiteAnalyzer bot for website analysis https://www.site-analyzer.com/
  • Similarweb bot for market intelligence https://support.similarweb.com/hc/en-us/articles/18091514382749-Similarweb-Bot
  • BLEXBot for SEO web crawling and data collection https://help.seranking.com/hc/en-us/articles/17126130916636-BLEXBot-Crawler
  • NetcraftSurveyAgent, https://www.netcraft.com/tools/
Back to top