maciag-offroad.de
robots.txt

Robots Exclusion Standard data for maciag-offroad.de

Resource Scan

Scan Details

Site Domain maciag-offroad.de
Base Domain maciag-offroad.de
Scan Status Ok
Last Scan2024-10-26T21:00:45+00:00
Next Scan 2024-11-25T21:00:45+00:00

Last Scan

Scanned2024-10-26T21:00:45+00:00
URL https://maciag-offroad.de/robots.txt
Redirect https://www.maciag-offroad.de/robots.txt
Redirect Domain www.maciag-offroad.de
Redirect Base maciag-offroad.de
Domain IPs 104.22.12.155, 104.22.13.155, 172.67.4.105, 2606:4700:10::6816:c9b, 2606:4700:10::6816:d9b, 2606:4700:10::ac43:469
Redirect IPs 104.22.12.155, 104.22.13.155, 172.67.4.105, 2606:4700:10::6816:c9b, 2606:4700:10::6816:d9b, 2606:4700:10::ac43:469
Response IP 172.67.4.105
Found Yes
Hash e2ff9d2ef362148b46246dfe57a8f008c3164c935dae155cda786a0d96296346
SimHash 291ada344ab7

Groups

*

Rule Path
Allow /js/
Allow /gfx/
Disallow /traffic_cookie.php
Disallow /_DEV_SHOP/
Disallow /warenkorb/
Disallow /checkout/
Disallow /my-account/
Disallow /mein-konto/
Disallow /_sr19/wawi/
Disallow /_sr19/_cronjobs/
Disallow /_sr19/_error_logs/
Disallow /_sr24/wawi/
Disallow /_sr24/_cronjobs/
Disallow /_sr24/_error_logs/
Disallow /admin/
Disallow /adventskalender/
Disallow /connectors.maciag-offroad.de/
Disallow /druckauftrag/
Disallow /logs/
Disallow /maciag-instagram2.0/
Disallow /includes/
Disallow /products/
Disallow /product-ratings/
Disallow /product-filter/
Disallow /sizing-chart/
Disallow /_cronjobs/
Disallow /_cache/
Disallow /export/
Disallow /bestand/
Disallow /shop/temp/
Disallow /shop/wawiAdminDateien/
Disallow /shop/wow-generator/
Disallow /shop/dod-generator/
Disallow /shop/adminSysTools/
Disallow /PayOne/
Disallow /PayPalExpress/
Disallow /AmazonPayments/
Disallow /shopMobileStats/
Disallow /mitarbeiter/
Disallow /emarsys/
Disallow /druckauftrag/
Disallow /gutschein-konfigurator/
Allow *?*ts_type_name=*
Disallow /*.*/
Disallow *?*nocache=*
Disallow *?*q=*
Disallow *?*sort=*
Disallow *?*gender=*
Disallow *?*onsale=*
Disallow *?*pricemax=*
Disallow *?*pricemin=*
Disallow *?*open_in_overlay=*
Disallow *?*type_name=*
Disallow *?*type=*
Disallow *?*product_group_mode=*
Disallow *?*salestype=*
Disallow *?*salediscount=*
Disallow *?*isnew=*
Disallow *?*isnew_for_days=*
Disallow *?*isgift=*
Disallow *?*color=*
Disallow *?*term=*
Disallow *?*line=*
Disallow *?*collection=*
Disallow *?*variant=*
Disallow *?*searchterms=*
Disallow *?*searchspecialterms=*
Disallow *?*opt_variant=*
Disallow *?*product_group_id=*
Disallow *?*product_subgroup_id=*
Disallow *?*has_video=*
Disallow *?*product_id=*
Disallow *?*ts_model=*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

voltron

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

Comments

  • URLs
  • Parameter
  • BOTS
  • SITEMAP
  • nicht aufnehmen, da international gültig