aeg.it
robots.txt

Robots Exclusion Standard data for aeg.it

Resource Scan

Scan Details

Site Domain aeg.it
Base Domain aeg.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-15T23:46:02+00:00
Next Scan 2025-02-13T23:46:02+00:00

Last Successful Scan

Scanned2024-03-28T23:24:54+00:00
URL https://aeg.it/robots.txt
Redirect https://www.aeg.it/robots.txt
Redirect Domain www.aeg.it
Redirect Base aeg.it
Domain IPs 23.50.94.113, 2600:1413:b000:382::395d, 2600:1413:b000:384::395d
Redirect IPs 23.50.89.97
Response IP 23.15.111.114
Found Yes
Hash 9ea6370273a4bf8963551c88eac83bf34983fffea1fa473c7dbdc8361eaeec85
SimHash ab1d404060ba

Groups

gsa-crawler

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /recycle-bin/
Disallow /util/
Disallow /secui/
Disallow /additions/
Disallow /templates/
Disallow /my-pages-container.*
Disallow /global/images/icons/
Disallow /localfiles/
Disallow /documents/
Disallow /pagefiles/
Disallow /global-pages/global-menu/store-locator/
Disallow /webresource.*
Disallow /node*.*
Disallow /find/
Disallow /compare/
Disallow /link/
Disallow /overlays/online-retailer/

Other Records

Field Value
sitemap https://www.aeg.it/globalassets/sitemaps/www.aeg.it/sitemapindex.xml