aw-lab.com
robots.txt
Robots Exclusion Standard data for aw-lab.com
Resource Scan
Scan Details
Site Domain | aw-lab.com |
Base Domain | aw-lab.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2025-06-08T13:46:44+00:00 |
Next Scan | 2025-09-06T13:46:44+00:00 |
Last Successful Scan
Scanned | 2022-11-16T00:21:05+00:00 |
URL | https://www.aw-lab.com/robots.txt |
Response IP | 23.215.7.6, 23.215.7.20 |
Found | Yes |
Hash | 0d34ee11060ef7953ecaab2626cfd411e38125c59ef9d5d6a6e252624b25e1e3 |
SimHash | 290d0c40a593 |
Groups
*
Rule | Path |
---|---|
Disallow | /search?q=* |
Disallow | /on/demandware.store/*/Product-Variation?pid=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.aw-lab.com/sitemap_index.xml |