ladendirekt.de
robots.txt

Robots Exclusion Standard data for ladendirekt.de

Resource Scan

Scan Details

Site Domain ladendirekt.de
Base Domain ladendirekt.de
Scan Status Ok
Last Scan2025-09-11T16:00:53+00:00
Next Scan 2025-09-18T16:00:53+00:00

Last Scan

Scanned2025-09-11T16:00:53+00:00
URL https://ladendirekt.de/robots.txt
Domain IPs 167.172.100.201
Response IP 167.172.100.201
Found Yes
Hash 38141430156cc494440f97487129456e9cf514a2b5aabc2323237155027db063
SimHash e11cdaf1c2f1

Groups

*

Rule Path
Disallow */impressions*
Disallow */clickout*
Disallow */merkzettel*
Disallow */last-seen*
Disallow */offers*
Disallow */prices*
Disallow */price-alerts*
Disallow */gtin-lookup*
Disallow */cdn-cgi*
Disallow *?page_no=*
Disallow *%26page_no%3D*
Disallow *?sort=*
Disallow *%26sort%3D*
Disallow *?has_discount=*
Disallow *%26has_discount%3D*
Disallow *?has_voucher=*
Disallow *%26has_voucher%3D*
Disallow *?free_delivery=*
Disallow *%26free_delivery%3D*
Disallow *?immediate_delivery=*
Disallow *%26immediate_delivery%3D*
Disallow *?price_min=*
Disallow *%26price_min%3D*
Disallow *?price_max=*
Disallow *%26price_max%3D*
Disallow *?width_min=*
Disallow *%26width_min%3D*
Disallow *?width_max=*
Disallow *%26width_max%3D*
Disallow *?height_min=*
Disallow *%26height_min%3D*
Disallow *?height_max=*
Disallow *%26height_max%3D*
Disallow *?depth_min=*
Disallow *%26depth_min%3D*
Disallow *?depth_max=*
Disallow *%26depth_max%3D*
Disallow *?brand=*
Disallow *%26brand%3D*
Disallow *?color=*
Disallow *%26color%3D*
Disallow *?color_id=*
Disallow *%26color_id%3D*
Disallow *?material=*
Disallow *%26material%3D*
Disallow *?partner_id=*
Disallow *%26partner_id%3D*
Disallow *?q=*
Disallow *%26q%3D*
Disallow *?view=*
Disallow *%26view%3D*

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

awariobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ladendirekt.de/ladendirekt-de-elektronik-sitemap.xml.gz