aemelectronics.com
robots.txt
Robots Exclusion Standard data for aemelectronics.com
Resource Scan
Scan Details
Site Domain | aemelectronics.com |
Base Domain | aemelectronics.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-14T02:59:35+00:00 |
Next Scan | 2025-12-13T02:59:35+00:00 |
Last Successful Scan
Scanned | 2024-04-30T02:54:43+00:00 |
URL | https://aemelectronics.com/robots.txt |
Redirect | https://www.aemelectronics.com/robots.txt |
Redirect Domain | www.aemelectronics.com |
Redirect Base | aemelectronics.com |
Domain IPs | 104.18.6.60, 104.18.7.60, 2606:4700::6812:63c, 2606:4700::6812:73c |
Redirect IPs | 104.18.6.60, 104.18.7.60, 2606:4700::6812:63c, 2606:4700::6812:73c |
Response IP | 104.18.6.60 |
Found | Yes |
Hash | d99555e50aa96814929f52213d245bf19fa5f8eae1086fe3c6e4143b4279877e |
SimHash | 65a8def2ea93 |
Groups
*
Rule | Path |
---|---|
Allow | /assets/php/account/accounthelper.php |
Disallow | /account/ |
Disallow | /search/ |
Disallow | /retailer/ |
Disallow | /search.asp |
Disallow | /store/recommendations.php |
Disallow | /store/recommendations/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.aemelectronics.com/sitemap/ |