bergstromauto.com
robots.txt
Robots Exclusion Standard data for bergstromauto.com
Resource Scan
Scan Details
| Site Domain | bergstromauto.com |
| Base Domain | bergstromauto.com |
| Scan Status | Ok |
| Last Scan | 2024-06-21T03:22:39+00:00 |
| Next Scan | 2024-07-21T03:22:39+00:00 |
Last Scan
| Scanned | 2024-06-21T03:22:39+00:00 |
| URL | https://bergstromauto.com/robots.txt |
| Redirect | https://www.bergstromauto.com/robots.txt |
| Redirect Domain | www.bergstromauto.com |
| Redirect Base | bergstromauto.com |
| Domain IPs | 13.33.30.24, 13.33.30.51, 13.33.30.86, 13.33.30.98 |
| Redirect IPs | 13.33.30.24, 13.33.30.51, 13.33.30.86, 13.33.30.98 |
| Response IP | 13.33.30.51 |
| Found | Yes |
| Hash | e17821dbdce687cefe20d27842c4a444717de70c0f3ba71ff758a4b9a53c02e6 |
| SimHash | eb2b1840a917 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*compareVehicleId%3D* |
| Disallow | /*cs%3A* |
| Disallow | /*.css |
| Disallow | /*.do |
| Disallow | /f_* |
| Disallow | /*.js |
| Disallow | /*jsessionid%3D* |
| Disallow | /?layer=* |
| Disallow | /*limit%3D* |
| Disallow | /*offset%3D* |
| Disallow | /*pageContext%3D* |
| Disallow | /*pageName%3D* |
| Disallow | /*referrer%3D* |
| Disallow | /*routePrefix%3D* |
| Disallow | /?trim=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bergstromauto.com/sitemap.xml |
| sitemap | https://www.bergstromauto.com/sitemap-mobile.xml |