hotrodtime.com
robots.txt
Robots Exclusion Standard data for hotrodtime.com
Resource Scan
Scan Details
| Site Domain | hotrodtime.com |
| Base Domain | hotrodtime.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-05-02T18:33:48+00:00 |
| Next Scan | 2024-07-31T18:33:48+00:00 |
Last Successful Scan
| Scanned | 2023-10-06T17:36:37+00:00 |
| URL | https://hotrodtime.com/robots.txt |
| Domain IPs | 50.31.98.241 |
| Response IP | 50.31.98.241 |
| Found | Yes |
| Hash | 01fcb2e3be8c1c7083990bb3604108af41cbd8300c874d3931bdd55de2232666 |
| SimHash | e804c2f8eff4 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*.js* |
| Allow | /*.css* |
| Allow | /*.png* |
| Allow | /*.jpg* |
| Allow | /*.gif* |
zoominfo bot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /administrator/ |
| Disallow | /bin/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Allow | /components/*.css |
| Allow | /components/*.js |
| Allow | /includes/*.css |
| Allow | /includes/*.js |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Allow | /layouts/*.css |
| Allow | /layouts/*.js |
| Disallow | /layouts/ |
| Allow | /libraries/*.css |
| Allow | /libraries/*.js |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Allow | /modules/*.css |
| Allow | /modules/*.js |
| Allow | /plugins/*.css |
| Allow | /plugins/*.js |
| Disallow | /tmp/ |
*
| Rule | Path |
|---|---|
| Allow | /sitemap-4seo.xml |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hotrodtime.com/sitemap.xml |
| sitemap | https://www.hotrodtime.com/sitemap-4seo.xml |
Warnings
- 2 invalid lines.
Comments