amresupply.com
robots.txt
Robots Exclusion Standard data for amresupply.com
Resource Scan
Scan Details
Site Domain | amresupply.com |
Base Domain | amresupply.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-22T15:09:04+00:00 |
Next Scan | 2024-06-05T15:09:04+00:00 |
Last Successful Scan
Scanned | 2024-04-14T11:26:36+00:00 |
URL | https://amresupply.com/robots.txt |
Redirect | https://www.amresupply.com/robots.txt |
Redirect Domain | www.amresupply.com |
Redirect Base | amresupply.com |
Domain IPs | 13.248.160.137, 75.2.43.150, 76.223.34.124, 99.83.186.106 |
Redirect IPs | 23.32.29.17, 23.32.29.8 |
Response IP | 23.32.29.8 |
Found | Yes |
Hash | ce96bea7a6de6e94b30c2b8f2e896e0e1d67ee8c9bc4593a9446e93bea403ffd |
SimHash | dc545d18af52 |
Groups
*
Rule | Path |
---|---|
Disallow | /diagram/ |
Disallow | /diagramenlarge/ |
Allow | /*catalog*?brands=* |
Disallow | /catalog*?* |
Disallow | /search*?* |
Disallow | /manufacturer*?* |
Disallow | /catalog*?brands=*&* |
Disallow | /catalog*?brands=*%2C* |
Disallow | /thumbnail/product/* |
Allow | /thumbnail/product/*/625/469/* |
Allow | /thumbnail/product/*/900/900/* |
Disallow | /thumbnail/brand/* |
Allow | /thumbnail/brand/*/220/100* |
Disallow | /thumbnail/category/* |
Allow | /thumbnail/category/*/400/400* |
Other Records
Field | Value |
---|---|
sitemap | https://www.amresupply.com/xml-amre-index.xml |