theenergydetective.com
robots.txt
Robots Exclusion Standard data for theenergydetective.com
Resource Scan
Scan Details
| Site Domain | theenergydetective.com |
| Base Domain | theenergydetective.com |
| Scan Status | Ok |
| Last Scan | 2024-09-29T08:46:55+00:00 |
| Next Scan | 2024-10-29T08:46:55+00:00 |
Last Scan
| Scanned | 2024-09-29T08:46:55+00:00 |
| URL | https://www.theenergydetective.com/robots.txt |
| Domain IPs | 104.239.197.129 |
| Response IP | 104.239.197.129 |
| Found | Yes |
| Hash | 5904c74cfa87d1813ba43cc0c47f0dd37427541d5c1a10e44338e5fcf8bd4bcf |
| SimHash | 7e069d50e08d |
Groups
facebookexternalhit
facebookcatalog
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /files/Metermaid-Recall-June2018.pdf |
| Disallow | /files/Metermaid-Recall-June2018-PMS.pdf |
| Disallow | /orders/bankInformation/ |
| Disallow | /content/frequently-asked-questions-on-rentals |
| Disallow | /content/rentals-terms-and-conditions |
| Disallow | /content/extra5-promo-code |
| Disallow | /fr/information/code-promo-extra5 |
| Disallow | /shop/* |
| Disallow | /files/R-Support/* |
| Disallow | /content/save5-promo-code |
| Disallow | /files/Metermaid-Recall-June2018.pdf |
| Disallow | /files/Metermaid-Recall-June2018-PMS.pdf |
| Disallow | /ajax/* |
| Disallow | /orders/bankInformation/ |
| Disallow | /content/frequently-asked-questions-on-rentals |
| Disallow | /content/rentals-terms-and-conditions |
| Disallow | /content/extra5-promo-code |
| Disallow | /fr/information/code-promo-extra5 |
| Disallow | /app/ip_info/Visitor/CountryCode |
| Disallow | /pdfs/resources/link-only/FLIR-What-Do-You-Need-to-Measure-2022-Brochures.pdf |
| Disallow | /files/REED-CAD-PRICING-2023.pdf |
| Disallow | /files/REED-USD-PRICING-2023.pdf |
| Disallow | /files/REED-CAD-PRICING-2023.xlsx |
| Disallow | /files/REED-USD-PRICING-2023.xlsx |
| Disallow | /files/itm-gts-2024-media-kit.pdf |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.theenergydetective.com/sitemap.xml |
Comments