tapetenunduhren.de
robots.txt

Robots Exclusion Standard data for tapetenunduhren.de

Resource Scan

Scan Details

Site Domain tapetenunduhren.de
Base Domain tapetenunduhren.de
Scan Status Ok
Last Scan2024-10-23T10:18:02+00:00
Next Scan 2024-11-22T10:18:02+00:00

Last Scan

Scanned2024-10-23T10:18:02+00:00
URL https://tapetenunduhren.de/robots.txt
Domain IPs 213.9.21.18
Response IP 213.9.21.18
Found Yes
Hash 8771efde9212a3c1b646c299593633f0831a40df1a3bda21669051cf46051b15
SimHash 6b46fd7a6891

Groups

*

Rule Path
Disallow /index.php/
Disallow /admin/
Disallow /app/
Disallow /catalog/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /customer/
Disallow /customize/
Disallow /downloader/
Disallow /enable-cookies
Disallow /home
Disallow /lib/
Disallow /newsletter/
Disallow /pkginfo/
Disallow /poll/
Disallow /privacy-policy-cookie-restriction-mode
Disallow /report/
Disallow /review/
Disallow /sendfriend/
Disallow /skin/
Disallow /tag/
Disallow /wishlist/

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks
seokicks-robot

Rule Path
Disallow /

yandexbot
yandexdirect
yandexdirectdyn
yandexmedia
yadirectfetcher
yandexblogs
yandexnews
yandexpagechecker
yandexmetrika
yandexcalendar

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

mail.ru_bot
mail.ru

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

vebot

Rule Path
Disallow /

adscanner/1.1

Rule Path
Disallow /

adscanner/1.0

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tapetenunduhren.de/pub/media/sitemap.xml

Comments

  • AhrefsBot
  • MajesticBot
  • YahooSlurpBot
  • SEMrushBot
  • SEOkicksBot
  • YandexBot
  • BaiduBot
  • SEOscannersBot
  • Mail.ruBot
  • CommonCrawlBot
  • SeznamBot
  • ShopWikiBot
  • TurnitonBot
  • DotBot
  • picsearch bot
  • Cliqzbot
  • SafeDNSBot
  • ltx71
  • BLEXBot, webmeup
  • Megaindex
  • Barkrowler/0.9 (http://www.exensa.com/crawl)
  • VEBot (https://www.ve.com/vebot)
  • adscanner (http://seocompany.store; spider@seocompany.store)
  • adscanner (http://seocompany.store; spider@seocompany.store)
  • adscanner (http://seocompany.store; spider@seocompany.store)