maciag-offroad.de
robots.txt

Robots Exclusion Standard data for maciag-offroad.de

Resource Scan

Scan Details

Site Domain maciag-offroad.de
Base Domain maciag-offroad.de
Scan Status Ok
Last Scan2024-08-27T20:59:58+00:00
Next Scan 2024-09-26T20:59:58+00:00

Last Scan

Scanned2024-08-27T20:59:58+00:00
URL https://maciag-offroad.de/robots.txt
Redirect https://www.maciag-offroad.de/robots.txt
Redirect Domain www.maciag-offroad.de
Redirect Base maciag-offroad.de
Domain IPs 104.22.12.155, 104.22.13.155, 172.67.4.105, 2606:4700:10::6816:c9b, 2606:4700:10::6816:d9b, 2606:4700:10::ac43:469
Redirect IPs 104.22.12.155, 104.22.13.155, 172.67.4.105, 2606:4700:10::6816:c9b, 2606:4700:10::6816:d9b, 2606:4700:10::ac43:469
Response IP 172.67.4.105
Found Yes
Hash 58e44b47a39e816346e2e65aff394547bae30203a43c7fd6ad346a069800a007
SimHash 291afa340b97

Groups

*

Rule Path
Allow /js/
Allow /gfx/
Disallow /traffic_cookie.php
Disallow /_DEV_SHOP/
Disallow /warenkorb/
Disallow /checkout/
Disallow /my-account/
Disallow /mein-konto/
Disallow /_sr19/wawi/
Disallow /_sr19/_cronjobs/
Disallow /_sr19/_error_logs/
Disallow /admin/
Disallow /adventskalender/
Disallow /connectors.maciag-offroad.de/
Disallow /druckauftrag/
Disallow /logs/
Disallow /maciag-instagram2.0/
Disallow /includes/
Disallow /products/
Disallow /product-ratings/
Disallow /product-filter/
Disallow /sizing-chart/
Disallow /_cronjobs/
Disallow /_cache/
Disallow /export/
Disallow /bestand/
Disallow /shop/temp/
Disallow /shop/wawiAdminDateien/
Disallow /shop/wow-generator/
Disallow /shop/dod-generator/
Disallow /shop/adminSysTools/
Disallow /PayOne/
Disallow /PayPalExpress/
Disallow /AmazonPayments/
Disallow /shopMobileStats/
Disallow /mitarbeiter/
Disallow /emarsys/
Disallow /druckauftrag/
Disallow /gutschein-konfigurator/
Disallow /product-shipping-data/
Allow *?*ts_type_name=*
Disallow /*.*/
Disallow *?*nocache=*
Disallow *?*q=*
Disallow *?*sort=*
Disallow *?*gender=*
Disallow *?*onsale=*
Disallow *?*pricemax=*
Disallow *?*pricemin=*
Disallow *?*open_in_overlay=*
Disallow *?*type_name=*
Disallow *?*type=*
Disallow *?*product_group_mode=*
Disallow *?*salestype=*
Disallow *?*salediscount=*
Disallow *?*isnew=*
Disallow *?*isnew_for_days=*
Disallow *?*isgift=*
Disallow *?*color=*
Disallow *?*term=*
Disallow *?*line=*
Disallow *?*collection=*
Disallow *?*variant=*
Disallow *?*searchterms=*
Disallow *?*searchspecialterms=*
Disallow *?*opt_variant=*
Disallow *?*product_group_id=*
Disallow *?*product_subgroup_id=*
Disallow *?*has_video=*
Disallow *?*product_id=*
Disallow *?*ts_model=*
Disallow *?*ts_model=*
Disallow *?*data-headline_classes=*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

voltron

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • URLs
  • Parameter
  • BOTS
  • SITEMAP
  • nicht aufnehmen, da international gültig