oeg.net
robots.txt
Robots Exclusion Standard data for oeg.net
Resource Scan
Scan Details
Site Domain | oeg.net |
Base Domain | oeg.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-13T17:23:18+00:00 |
Next Scan | 2024-07-12T17:23:18+00:00 |
Last Successful Scan
Scanned | 2023-11-23T08:59:14+00:00 |
URL | https://oeg.net/robots.txt |
Redirect | https://www.oeg.net/robots.txt |
Redirect Domain | www.oeg.net |
Redirect Base | oeg.net |
Domain IPs | 172.66.40.137, 172.66.43.119, 2606:4700:3108::ac42:2889, 2606:4700:3108::ac42:2b77 |
Redirect IPs | 172.66.40.137, 172.66.43.119, 2606:4700:3108::ac42:2889, 2606:4700:3108::ac42:2b77 |
Response IP | 172.66.40.137 |
Found | Yes |
Hash | 1b31d1e646621390011300cdcc538100990fc2112e795bae7cadc19e9d9efc7d |
SimHash | 662999d00956 |
Groups
*
Rule | Path |
---|---|
Disallow | /static/wartung |
Disallow | */account/* |
Disallow | */cart/id/*/ |
Disallow | */frontend/article/suggest |
Disallow | */account/contact/add |
Disallow | */guest/addressbook/billing |
Disallow | */*/service/download/file/* |
Disallow | /search$ |
Disallow | /*/search$ |
Disallow | /*/search/* |
Disallow | /*/search?* |
Disallow | */*/navigation/breadcrumb/* |
Disallow | */*/article/id/*/download/* |
Disallow | */*/article/id/*/datasheet/* |
Disallow | */*/article/id/*/document/* |
Disallow | */*/article/id/*/label/erp/* |
Disallow | /*/rating/article/* |
Disallow | /*/rating/group/* |
Disallow | /*/rating/translation/* |
Disallow | */*/layer/1 |
Disallow | *?language=* |
Disallow | *%26language%3D* |
Disallow | */*/layer/1 |
Disallow | /system/connect/ids |
Other Records
Field | Value |
---|---|
sitemap | https://www.oeg.net/static/sitemap/articles-index |
sitemap | https://www.oeg.net/static/sitemap/pages-index |
Comments