globalindustrial.com
robots.txt
Robots Exclusion Standard data for globalindustrial.com
Resource Scan
Scan Details
| Site Domain | globalindustrial.com |
| Base Domain | globalindustrial.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-08T03:46:25+00:00 |
| Next Scan | 2024-12-08T03:46:25+00:00 |
Last Successful Scan
| Scanned | 2024-09-17T03:33:06+00:00 |
| URL | https://globalindustrial.com/robots.txt |
| Redirect | https://www.globalindustrial.com/robots.txt |
| Redirect Domain | www.globalindustrial.com |
| Redirect Base | globalindustrial.com |
| Domain IPs | 34.213.106.51, 54.68.182.72 |
| Redirect IPs | 108.157.252.6, 2600:9000:2753:2800:4:816d:79d3:b0c1, 2600:9000:2753:2e00:4:816d:79d3:b0c1, 2600:9000:2753:600:4:816d:79d3:b0c1, 2600:9000:2753:7a00:4:816d:79d3:b0c1, 2600:9000:2753:8400:4:816d:79d3:b0c1, 2600:9000:2753:8600:4:816d:79d3:b0c1, 2600:9000:2753:e00:4:816d:79d3:b0c1, 2600:9000:2753:f800:4:816d:79d3:b0c1 |
| Response IP | 108.157.252.6 |
| Found | Yes |
| Hash | 02f1fd6eceb63c8752603a0c8335849d27201c66e24c2471072f4203ea833ad7 |
| SimHash | 443f5870c211 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /checkout/ |
| Disallow | /viewCart |
| Disallow | /printProduct/ |
| Disallow | /quickView |
| Disallow | /reviewProduct |
| Disallow | /calculateProductShippingPage |
| Disallow | /emailProduct |
| Disallow | /emailProductComparePage |
| Disallow | /PartsFinder |
| Disallow | /PrintProductCompare |
| Disallow | /productFinder |
| Disallow | /productCompare |
| Disallow | /searchResult |
| Disallow | /shopByBrand |
| Disallow | /sellerListing |
| Disallow | /printProduct |
| Disallow | /calculateProductShipping |
| Disallow | /page/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.globalindustrial.com/sitemap_index.xml |
Comments