oeg.net
robots.txt

Robots Exclusion Standard data for oeg.net

Resource Scan

Scan Details

Site Domain oeg.net
Base Domain oeg.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-13T17:23:18+00:00
Next Scan 2024-07-12T17:23:18+00:00

Last Successful Scan

Scanned2023-11-23T08:59:14+00:00
URL https://oeg.net/robots.txt
Redirect https://www.oeg.net/robots.txt
Redirect Domain www.oeg.net
Redirect Base oeg.net
Domain IPs 172.66.40.137, 172.66.43.119, 2606:4700:3108::ac42:2889, 2606:4700:3108::ac42:2b77
Redirect IPs 172.66.40.137, 172.66.43.119, 2606:4700:3108::ac42:2889, 2606:4700:3108::ac42:2b77
Response IP 172.66.40.137
Found Yes
Hash 1b31d1e646621390011300cdcc538100990fc2112e795bae7cadc19e9d9efc7d
SimHash 662999d00956

Groups

*

Rule Path
Disallow /static/wartung
Disallow */account/*
Disallow */cart/id/*/
Disallow */frontend/article/suggest
Disallow */account/contact/add
Disallow */guest/addressbook/billing
Disallow */*/service/download/file/*
Disallow /search$
Disallow /*/search$
Disallow /*/search/*
Disallow /*/search?*
Disallow */*/navigation/breadcrumb/*
Disallow */*/article/id/*/download/*
Disallow */*/article/id/*/datasheet/*
Disallow */*/article/id/*/document/*
Disallow */*/article/id/*/label/erp/*
Disallow /*/rating/article/*
Disallow /*/rating/group/*
Disallow /*/rating/translation/*
Disallow */*/layer/1
Disallow *?language=*
Disallow *%26language%3D*
Disallow */*/layer/1
Disallow /system/connect/ids

Other Records

Field Value
sitemap https://www.oeg.net/static/sitemap/articles-index
sitemap https://www.oeg.net/static/sitemap/pages-index

Comments

  • cart actions
  • search
  • navigation
  • article downloads
  • ratings (iframe)
  • todo: erst auf no-index,
  • wichtig disallow niemals auf "page" param!
  • Filter / Sort params
  • Disallow: *?showVariants=*
  • Disallow: *&showVariants=*
  • Disallow: *&sort=*
  • Disallow: *?sort=*
  • Disallow: *&filter=*
  • Disallow: *?filter=*
  • todo: erst auf no-index
  • Disallow: */*/spare-part-for
  • todo: erst auf no-index
  • Disallow: *?icp=*
  • Disallow: *&icp=*
  • Disallow: *?code=*
  • Disallow: *&code=*