gordonelectricsupply.com
robots.txt
Robots Exclusion Standard data for gordonelectricsupply.com
Resource Scan
Scan Details
Site Domain | gordonelectricsupply.com |
Base Domain | gordonelectricsupply.com |
Scan Status | Ok |
Last Scan | 2024-09-14T18:21:17+00:00 |
Next Scan | 2024-10-14T18:21:17+00:00 |
Last Scan
Scanned | 2024-09-14T18:21:17+00:00 |
URL | https://gordonelectricsupply.com/robots.txt |
Redirect | https://www.gordonelectricsupply.com/robots.txt |
Redirect Domain | www.gordonelectricsupply.com |
Redirect Base | gordonelectricsupply.com |
Domain IPs | 104.22.76.209, 104.22.77.209, 172.67.36.44 |
Redirect IPs | 104.22.76.209, 104.22.77.209, 172.67.36.44 |
Response IP | 104.22.77.209 |
Found | Yes |
Hash | 3396d12b1720e2fb0089b3d8a36f3449208bb3085227fdec4e2214c78366bf05 |
SimHash | 571fd2a24986 |
Groups
*
Rule | Path |
---|---|
Disallow | /visit.php |
Disallow | *mfr* |
Disallow | *?* |
Disallow | *Overstock* |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | http://www.gordonelectricsupply.com/sitemap-index.xml |
sitemap | https://www.gordonelectricsupply.com/sitemap.xml |
Warnings
- 26 invalid lines.