energybot.com
robots.txt
Robots Exclusion Standard data for energybot.com
Resource Scan
Scan Details
| Site Domain | energybot.com |
| Base Domain | energybot.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-21T10:56:04+00:00 |
| Next Scan | 2024-06-19T10:56:04+00:00 |
Last Successful Scan
| Scanned | 2023-10-31T10:23:20+00:00 |
| URL | https://energybot.com/robots.txt |
| Redirect | https://www.energybot.com/robots.txt |
| Redirect Domain | www.energybot.com |
| Redirect Base | energybot.com |
| Domain IPs | 13.225.142.121, 13.225.142.24, 13.225.142.46, 13.225.142.54 |
| Redirect IPs | 13.33.88.25, 13.33.88.28, 13.33.88.5, 13.33.88.55, 2600:9000:223b:4c00:1e:1cd2:8380:93a1, 2600:9000:223b:5400:1e:1cd2:8380:93a1, 2600:9000:223b:9200:1e:1cd2:8380:93a1, 2600:9000:223b:a000:1e:1cd2:8380:93a1, 2600:9000:223b:a00:1e:1cd2:8380:93a1, 2600:9000:223b:c800:1e:1cd2:8380:93a1, 2600:9000:223b:d400:1e:1cd2:8380:93a1, 2600:9000:223b:f000:1e:1cd2:8380:93a1 |
| Response IP | 18.161.111.28 |
| Found | Yes |
| Hash | 38285133d02f5d2222e792ceabe78ff4774a88461bc9f60eb3a9416b4625398b |
| SimHash | ac49680088b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin-service* |
| Disallow | /browser-not-supported.html |
| Disallow | /business-home.html |
| Disallow | /business-home-energyscore.html |
| Disallow | /business-home-quick-price.html |
| Disallow | /business-home-quote.html |
| Disallow | /business-home-check-your-rate.html |
| Disallow | /confirmation-link-expired.html |
| Disallow | /custom-dashboard-intro.html |
| Disallow | /dashboard-intro.html |
| Disallow | /dashboard.html |
| Disallow | /home-alt.html |
| Disallow | /home-v2.html |
| Disallow | /out-of-range.html |
| Disallow | /logout-redirect.html |
| Disallow | /shop* |
| Disallow | /app-ui* |
| Disallow | /app.html |
| Disallow | /template* |
| Disallow | /thanks.html |
| Disallow | /thanks-2.html |
| Disallow | /api* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.energybot.com/sitemap.xml |