udobaer.de
robots.txt

Robots Exclusion Standard data for udobaer.de

Resource Scan

Scan Details

Site Domain udobaer.de
Base Domain udobaer.de
Scan Status Ok
Last Scan2025-03-09T14:49:48+00:00
Next Scan 2025-04-08T14:49:48+00:00

Last Scan

Scanned2025-03-09T14:49:48+00:00
URL https://udobaer.de/robots.txt
Redirect https://www.udobaer.de/robots.txt
Redirect Domain www.udobaer.de
Redirect Base udobaer.de
Domain IPs 13.226.2.119, 13.226.2.40, 13.226.2.41, 13.226.2.64
Redirect IPs 18.154.144.126, 18.154.144.127, 18.154.144.3, 18.154.144.53
Response IP 3.164.68.34
Found Yes
Hash b10f34fdb214ca0084d44dcf59f0049628af6af601787b1c9a96696c77e401f6
SimHash 6f1c0a41c758

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

botify

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*
bingbot
adidxbot
msnbot-media

Rule Path
Disallow /?b2c=
Disallow /*?*s=
Disallow /*?*ps=
Disallow /*?*suggest=
Disallow /*?*sp=
Disallow /anmelden
Disallow /registrieren
Disallow */ViewProduct-VariationListItemAddToCart
Disallow */ViewProduct-PriceWrapper
Disallow /INTERSHOP/web/WFS/UDOBAER-UBDE-Site/de_DE/-/EUR/GetProductData-FormatProduct
Disallow /INTERSHOP/web/WFS/UDOBAER-UBOCIDE-Site/
Disallow /schnellbestellung
Disallow *SearchTerm*
Disallow *SearchParameter*
Disallow *JumpTarget*
Disallow *ViewStandardCatalog-Browse*
Disallow *add-to-ordertemplate*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.udobaer.de/INTERSHOP/web/WFS/UDOBAER-UBDE-Site/de_DE/-/EUR/ViewSiteMapXML-Start?SyndicationID=SITEMAP_FEED