aeg.be
robots.txt
Robots Exclusion Standard data for aeg.be
Resource Scan
Scan Details
| Site Domain | aeg.be |
| Base Domain | aeg.be |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-03T19:52:17+00:00 |
| Next Scan | 2024-12-02T19:52:17+00:00 |
Last Successful Scan
| Scanned | 2024-04-14T17:23:26+00:00 |
| URL | https://aeg.be/robots.txt |
| Redirect | https://www.aeg.be/robots.txt |
| Redirect Domain | www.aeg.be |
| Redirect Base | aeg.be |
| Domain IPs | 23.65.248.112 |
| Redirect IPs | 23.15.111.114 |
| Response IP | 23.15.111.114 |
| Found | Yes |
| Hash | 11c2c4d6dd488120c44ac747aa05a4b86ef9bd63fbb06575dade0496b9f7417b |
| SimHash | ab1bc402ecaa |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /recycle-bin/ |
| Disallow | /util/ |
| Disallow | /secui/ |
| Disallow | /additions/ |
| Disallow | /templates/ |
| Disallow | /my-pages-container.* |
| Disallow | /global/images/icons/ |
| Disallow | /localfiles/ |
| Disallow | /documents/ |
| Disallow | /pagefiles/ |
| Disallow | /global-pages/global-menu/store-locator/ |
| Disallow | /webresource.* |
| Disallow | /node*.* |
| Disallow | /find/ |
| Disallow | /compare/ |
| Disallow | /link/ |
| Disallow | /overlays/online-retailer/ |
| Disallow | /mypages/register-a-product/?q* |
| Disallow | /search/?q* |
| Disallow | /support/store-locator/?q* |
| Disallow | */modallogin/.* |
| Disallow | */mypages/* |
| Disallow | */search/?q=* |
| Disallow | *%26Facet* |
| Disallow | *%26facet* |
| Disallow | *%26FACET* |
| Disallow | */archive/ |
| Disallow | *?navId* |
| Disallow | /downloadpdf/ |
| Disallow | */getreviewsection/ |
| Disallow | */getpopularproductssession/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aeg.be/globalassets/sitemaps/www.aeg.be/sitemapindex.xml |