pro-biomarkt.de
robots.txt

Robots Exclusion Standard data for pro-biomarkt.de

Resource Scan

Scan Details

Site Domain pro-biomarkt.de
Base Domain pro-biomarkt.de
Scan Status Ok
Last Scan2024-11-06T20:24:41+00:00
Next Scan 2024-12-06T20:24:41+00:00

Last Scan

Scanned2024-11-06T20:24:41+00:00
URL https://pro-biomarkt.de/robots.txt
Redirect https://www.pro-biomarkt.de/robots.txt
Redirect Domain www.pro-biomarkt.de
Redirect Base pro-biomarkt.de
Domain IPs 188.40.32.15
Redirect IPs 188.40.32.15
Response IP 188.40.32.15
Found Yes
Hash d3f63d196a2eb7b3c0587d6ab421c7459ee45d2fd80427df85df5da41f5ec108
SimHash 094c9ff6c099

Groups

*

Rule Path
Allow /
Disallow /bundles/
Disallow /theme/
Disallow /admindb/
Disallow /sig/
Disallow /thumbnail/
Disallow /recovery/
Disallow /js/
Disallow /fonts/
Disallow /css/
Disallow /wishlist
Disallow /account
Disallow /checkout
Disallow /widgets
Disallow /navigation
Disallow /mollie
Disallow /payment
Disallow /paypal
Disallow /staging64zu66
Disallow /staging
Disallow /wcvk9y97qs6lme1fiu1jeh6rmfrv5t.html
Disallow /sw-domain-hash.html
Disallow /maintenance.html

googlebot-image

Rule Path
Disallow /thumbnail/

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.pro-biomarkt.de/sitemap.xml

Comments

  • Directories
  • Paths
  • Files
  • Google Image Crawler Setup