crescentelectric.com
robots.txt
Robots Exclusion Standard data for crescentelectric.com
Resource Scan
Scan Details
| Site Domain | crescentelectric.com |
| Base Domain | crescentelectric.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T06:10:55+00:00 |
| Next Scan | 2024-10-05T06:10:55+00:00 |
Last Scan
| Scanned | 2024-09-21T06:10:55+00:00 |
| URL | https://crescentelectric.com/robots.txt |
| Redirect | https://www.crescentelectric.com/robots.txt |
| Redirect Domain | www.crescentelectric.com |
| Redirect Base | crescentelectric.com |
| Domain IPs | 217.114.85.70 |
| Redirect IPs | 104.18.32.191, 172.64.155.65, 2606:4700:4400::6812:20bf, 2606:4700:4400::ac40:9b41 |
| Response IP | 104.18.32.191 |
| Found | Yes |
| Hash | 86ce3f3d46bcc7f64d93c00fbca4a99557723ff368a800192e86615267e603ec |
| SimHash | b925cb0e69d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /episerver* |
| Disallow | /cart |
| Disallow | /my-account/ |
| Disallow | /employee-services |
| Disallow | /compare-products |
| Disallow | /search* |
| Disallow | *?Item* |
| Disallow | *%26Item* |
| Disallow | *?s=* |
| Disallow | *%26s%3D* |
| Disallow | *?ps=* |
| Disallow | *%26ps%3D* |
| Disallow | /*.pdf$ |
| Disallow | /en/api* |
| Disallow | /en/api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.crescentelectric.com/sitemapindex.xml |
Comments