olibetta.de
robots.txt

Robots Exclusion Standard data for olibetta.de

Resource Scan

Scan Details

Site Domain olibetta.de
Base Domain olibetta.de
Scan Status Ok
Last Scan2025-11-23T00:08:07+00:00
Next Scan 2025-11-30T00:08:07+00:00

Last Scan

Scanned2025-11-23T00:08:07+00:00
URL https://olibetta.de/robots.txt
Redirect https://www.olibetta.de/robots.txt
Redirect Domain www.olibetta.de
Redirect Base olibetta.de
Domain IPs 148.251.119.200
Redirect IPs 148.251.119.200
Response IP 148.251.119.200
Found Yes
Hash a002ea6c86b41f482cc845a6ead4b3ac23bccb839fa47b75cbfe4eda40e0f13a
SimHash 1a0d18d3ab9b

Groups

w2gbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sogou
sogou-image
sogou-video

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider
baiduspider-image
baiduspider-news
baiduspider-video

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /kunden/*
Disallow /webshop/*

Other Records

Field Value
sitemap https://www.olibetta.de/sitemap-c.xml
sitemap https://www.olibetta.de/sitemap-cs.xml
sitemap https://www.olibetta.de/sitemap-p.xml
sitemap https://www.olibetta.de/sitemap-p404.xml
sitemap https://www.olibetta.de/sitemap-i.xml
sitemap https://www.olibetta.de/sitemap-sp.xml
sitemap https://www.olibetta.de/sitemap-r.xml
sitemap https://www.olibetta.de/update.rss

Comments

  • robots.txt

Warnings

  • 4 invalid lines.