schaefer-shop.at
robots.txt

Robots Exclusion Standard data for schaefer-shop.at

Resource Scan

Scan Details

Site Domain schaefer-shop.at
Base Domain schaefer-shop.at
Scan Status Ok
Last Scan2024-11-13T04:05:45+00:00
Next Scan 2024-11-27T04:05:45+00:00

Last Scan

Scanned2024-11-13T04:05:45+00:00
URL https://schaefer-shop.at/robots.txt
Redirect https://www.schaefer-shop.at/robots.txt
Redirect Domain www.schaefer-shop.at
Redirect Base schaefer-shop.at
Domain IPs 167.235.217.66
Redirect IPs 23.209.46.26, 23.209.46.30, 2600:1413:b000:1e::17d1:2e4c, 2600:1413:b000:1e::17d1:2e50
Response IP 23.45.207.165
Found Yes
Hash 9fdcf2523bc4a3bb7b16fda3e3e433fab96294ac029eb7a842154f44b15376e5
SimHash d11c5053e6a3

Groups

*

Rule Path
Disallow /shop/
Disallow /h/
Disallow /search/
Disallow /print/
Disallow /.well-known/
Disallow /g/
Disallow /stores/
Disallow /cms/blog/search
Disallow /pricing/
Disallow /mapping/
Disallow /user/profile/
Disallow /produkt/
Disallow /order/
Disallow /rating/
Disallow /en/
Disallow /product/comparison/
Disallow /product/reminder/article/
Disallow /user/lang/
Disallow /p/*https%3A//media
Disallow /*query%3D*
Disallow /*fprofile%3D*
Disallow /*status%3D*
Disallow /*originalSearchTerm%3D*
Disallow /*productId%3D*
Disallow /*categoryId%3D*
Disallow /*source%3D*
Disallow /*layout%3D*
Disallow /*tenant%3D*
Disallow /*local%3D*
Disallow /*reco%3D*

gptbot

Rule Path
Allow /ueberuns
Allow /p/
Disallow /

chatgpt-user

Rule Path
Allow /p/
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

siteauditbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /order/cart

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.schaefer-shop.at/product/sitemap/sitemap.xml
sitemap https://www.schaefer-shop.at/product/sitemap/sitemap-image.xml

Comments

  • Sitemaps
  • Other Bots:

Warnings

  • 2 invalid lines.