Log In Sign Up

eshop.empiria.sk
robots.txt

Robots Exclusion Standard data for eshop.empiria.sk

Resource Scan

Scan Details

Site Domain eshop.empiria.sk
Base Domain empiria.sk
Scan Status Ok
Last Scan2024-09-30T04:49:42+00:00
Next Scan 2024-10-30T04:49:42+00:00

Last Scan

Scanned2024-09-30T04:49:42+00:00
URL https://eshop.empiria.sk/robots.txt
Domain IPs 213.81.205.7
Response IP 213.81.205.7
Found Yes
Hash 828af7b5dfe242c0aca40a6753db8b3491cb3ca8b741101a3d27e3570a23cd8d
SimHash 41451c3106c2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /trackback
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Allow /

barkrowler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

neticle

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://eshop.empiria.sk/sitemap-01.xml
sitemap https://eshop.empiria.sk/sitemap-02.xml
sitemap https://eshop.empiria.sk/sitemap-images-01.xml
sitemap https://eshop.empiria.sk/sitemap-images-02.xml
Back to top

Comments

  • babbar.tech/crawler
  • babbar.tech/crawler
  • brandwatch.net
  • brandwatch.net
  • opensiteexplorer.org/dotbot
  • moz.com/help/moz-procedures/crawlers/rogerbot
  • ahrefs.com
  • semrush.com
  • webmaster.petalsearch.com/site/petalbot
  • majestic.com
  • yandex.com
  • yandex.com
  • dataforseo.com/dataforseo-bot
  • help.coccoc.com/search-engine
  • mojeek.com/bot.html
  • bot.neticle.hu
  • webmeup-crawler.com
  • AdsTxtCrawlerTP
  • _______ ________ ___ ___ ________ ________
  • |\ ___ \ |\ ____\|\ \|\ \|\ __ \|\ __ \
  • \ \ __/|\ \ \___|\ \ \\\ \ \ \|\ \ \ \|\ \
  • \ \ \_|/_\ \_____ \ \ __ \ \ \\\ \ \ ____\
  • \ \ \_|\ \|____|\ \ \ \ \ \ \ \\\ \ \ \___|
  • \ \_______\____\_\ \ \__\ \__\ \_______\ \__\
  • \|_______|\_________\|__|\|__|\|_______|\|__|
  • \|_________|
  • _______ _____ ______ ________ ___ ________ ___ ________
  • |\ ___ \ |\ _ \ _ \|\ __ \|\ \|\ __ \|\ \|\ __ \
  • \ \ __/|\ \ \\\__\ \ \ \ \|\ \ \ \ \ \|\ \ \ \ \ \|\ \
  • \ \ \_|/_\ \ \\|__| \ \ \ ____\ \ \ \ _ _\ \ \ \ __ \
  • \ \ \_|\ \ \ \ \ \ \ \ \___|\ \ \ \ \\ \\ \ \ \ \ \ \
  • \ \_______\ \__\ \ \__\ \__\ \ \__\ \__\\ _\\ \__\ \__\ \__\
  • \|_______|\|__| \|__|\|__| \|__|\|__|\|__|\|__|\|__|\|__|
Back to top