cdn1.automobilesreview.com
robots.txt
Robots Exclusion Standard data for cdn1.automobilesreview.com
Resource Scan
Scan Details
| Site Domain | cdn1.automobilesreview.com |
| Base Domain | automobilesreview.com |
| Scan Status | Ok |
| Last Scan | 2024-06-17T14:29:17+00:00 |
| Next Scan | 2024-07-17T14:29:17+00:00 |
Last Scan
| Scanned | 2024-06-17T14:29:17+00:00 |
| URL | https://cdn1.automobilesreview.com/robots.txt |
| Domain IPs | 104.21.57.237, 172.67.193.129, 2606:4700:3035::ac43:c181, 2606:4700:3037::6815:39ed |
| Response IP | 104.21.57.237 |
| Found | Yes |
| Hash | ab5b4503f8571cc52ec2d4df1f526488de71003990dcd77b97192de5b11e265c |
| SimHash | de01d73272a8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/ |
| Allow | /img/*.jpg$ |
| Allow | /img/*.jpeg$ |
| Allow | /img/*.gif$ |
| Allow | /img/*.png$ |
| Disallow | /img/ |
Warnings
- 1 invalid line.