schaefer-shop.de
robots.txt

Robots Exclusion Standard data for schaefer-shop.de

Resource Scan

Scan Details

Site Domain schaefer-shop.de
Base Domain schaefer-shop.de
Scan Status Ok
Last Scan2024-10-29T07:35:22+00:00
Next Scan 2024-11-12T07:35:22+00:00

Last Scan

Scanned2024-10-29T07:35:22+00:00
URL https://schaefer-shop.de/robots.txt
Redirect https://www.schaefer-shop.de/robots.txt
Redirect Domain www.schaefer-shop.de
Redirect Base schaefer-shop.de
Domain IPs 167.235.217.66
Redirect IPs 23.46.230.148, 23.46.230.156, 2600:1413:b000:1e::17d1:2e48, 2600:1413:b000:1e::17d1:2e49
Response IP 23.45.207.175
Found Yes
Hash ea165565d14b0bc80aa674259aa221fd3553cc229e00b2eaca194ba21002f1f0
SimHash 701c9050a601

Groups

*

Rule Path
Disallow /shop/
Disallow /h/
Disallow /search/
Disallow /print/
Disallow /.well-known/
Disallow /g/
Disallow /stores/
Disallow /cms/blog/search
Disallow /pricing/
Disallow /mapping/
Disallow /user/profile/
Disallow /produkt/
Disallow /order/
Disallow /rating/
Disallow /en/
Disallow /product/comparison/
Disallow /product/reminder/article/
Disallow /user/lang/
Disallow /*1%26utm_medium%3Daffiliate%26utm_campaign%3D%21%21%21affid%21%21%21
Disallow /p/*https%3A//media

gptbot

Rule Path
Allow /ueberuns
Allow /p/
Disallow /

chatgpt-user

Rule Path
Allow /p/
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

siteauditbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.schaefer-shop.de/product/sitemap/sitemap.xml
sitemap https://www.schaefer-shop.de/product/sitemap/sitemap-image.xml

Comments

  • Sitemaps
  • Other Bots:

Warnings

  • 2 invalid lines.