Log In Sign Up

empiria.sk
robots.txt

Robots Exclusion Standard data for empiria.sk

Resource Scan

Scan Details

Site Domain empiria.sk
Base Domain empiria.sk
Scan Status Ok
Last Scan2024-09-17T05:29:31+00:00
Next Scan 2024-10-17T05:29:31+00:00

Last Scan

Scanned2024-09-17T05:29:31+00:00
URL https://empiria.sk/robots.txt
Domain IPs 37.9.175.131
Response IP 37.9.175.131
Found Yes
Hash b0ed8fe75663e258010922395f6cbf640f85ec60e306640046567fa363fcf2b1
SimHash c94d143196c2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /trackback
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$

barkrowler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

neticle

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.empiria.sk/page-sitemap.xml
sitemap https://eshop.empiria.sk/sitemap-01.xml
sitemap https://eshop.empiria.sk/sitemap-02.xml
sitemap https://eshop.empiria.sk/sitemap-images-01.xml
sitemap https://eshop.empiria.sk/sitemap-images-02.xml
Back to top

Comments

  • babbar.tech/crawler
  • babbar.tech/crawler
  • brandwatch.net
  • brandwatch.net
  • opensiteexplorer.org/dotbot
  • moz.com/help/moz-procedures/crawlers/rogerbot
  • ahrefs.com
  • semrush.com
  • webmaster.petalsearch.com/site/petalbot
  • majestic.com
  • yandex.com
  • yandex.com
  • dataforseo.com/dataforseo-bot
  • help.coccoc.com/search-engine
  • mojeek.com/bot.html
  • bot.neticle.hu
  • webmeup-crawler.com
  • AdsTxtCrawlerTP
  • _______ _____ ______ ________ ___ ________ ___ ________
  • |\ ___ \ |\ _ \ _ \|\ __ \|\ \|\ __ \|\ \|\ __ \
  • \ \ __/|\ \ \\\__\ \ \ \ \|\ \ \ \ \ \|\ \ \ \ \ \|\ \
  • \ \ \_|/_\ \ \\|__| \ \ \ ____\ \ \ \ _ _\ \ \ \ __ \
  • \ \ \_|\ \ \ \ \ \ \ \ \___|\ \ \ \ \\ \\ \ \ \ \ \ \
  • \ \_______\ \__\ \ \__\ \__\ \ \__\ \__\\ _\\ \__\ \__\ \__\
  • \|_______|\|__| \|__|\|__| \|__|\|__|\|__|\|__|\|__|\|__|
Back to top

Warnings

  • 1 invalid line.
Back to top