schaefer-shop.be
robots.txt

Robots Exclusion Standard data for schaefer-shop.be

Resource Scan

Scan Details

Site Domain schaefer-shop.be
Base Domain schaefer-shop.be
Scan Status Ok
Last Scan2026-02-01T13:26:21+00:00
Next Scan 2026-02-15T13:26:21+00:00

Last Scan

Scanned2026-02-01T13:26:21+00:00
URL https://schaefer-shop.be/robots.txt
Redirect https://www.schaefer-shop.be/robots.txt
Redirect Domain www.schaefer-shop.be
Redirect Base schaefer-shop.be
Domain IPs 167.235.217.66
Redirect IPs 23.54.118.101, 23.54.118.104, 23.54.118.77, 23.54.118.79, 23.54.118.88, 2600:1413:b000:1e::17d1:2e4b, 2600:1413:b000:1e::17d1:2e59
Response IP 23.56.97.43
Found Yes
Hash f6d686e6a2c8a1e3e882d3b590d642ddd38fd13f2b05ecbca16dcbbbf6de1786
SimHash cd5cdcd2a683

Groups

*

Rule Path
Disallow /shop/
Disallow /h/
Disallow /search/
Disallow /print/
Disallow /.well-known/
Disallow /g/
Disallow /stores/
Disallow /cms/blog/search
Disallow /pricing/
Disallow /mapping/
Disallow /user/profile/
Disallow /produkt/
Disallow /order/
Disallow /rating/
Disallow /en/
Disallow /product/comparison/
Disallow /product/reminder/article/
Disallow /user/lang/
Disallow /p/*https%3A//media
Disallow /fr/p/*https%3A//media

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

siteauditbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.schaefer-shop.be/product/sitemap/sitemap.xml
sitemap https://www.schaefer-shop.be/product/sitemap/sitemap-image.xml
sitemap https://www.schaefer-shop.be/fr/product/sitemap/sitemap.xml

Comments

  • Sitemaps
  • Other Bots:

Warnings

  • 2 invalid lines.