aemelectronics.com
robots.txt

Robots Exclusion Standard data for aemelectronics.com

Resource Scan

Scan Details

Site Domain aemelectronics.com
Base Domain aemelectronics.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-14T02:59:35+00:00
Next Scan 2025-12-13T02:59:35+00:00

Last Successful Scan

Scanned2024-04-30T02:54:43+00:00
URL https://aemelectronics.com/robots.txt
Redirect https://www.aemelectronics.com/robots.txt
Redirect Domain www.aemelectronics.com
Redirect Base aemelectronics.com
Domain IPs 104.18.6.60, 104.18.7.60, 2606:4700::6812:63c, 2606:4700::6812:73c
Redirect IPs 104.18.6.60, 104.18.7.60, 2606:4700::6812:63c, 2606:4700::6812:73c
Response IP 104.18.6.60
Found Yes
Hash d99555e50aa96814929f52213d245bf19fa5f8eae1086fe3c6e4143b4279877e
SimHash 65a8def2ea93

Groups

*

Rule Path
Allow /assets/php/account/accounthelper.php
Disallow /account/
Disallow /search/
Disallow /retailer/
Disallow /search.asp
Disallow /store/recommendations.php
Disallow /store/recommendations/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.aemelectronics.com/sitemap/