gomotors.net
robots.txt
Robots Exclusion Standard data for gomotors.net
Resource Scan
Scan Details
| Site Domain | gomotors.net |
| Base Domain | gomotors.net |
| Scan Status | Ok |
| Last Scan | 2024-05-31T19:32:07+00:00 |
| Next Scan | 2024-06-07T19:32:07+00:00 |
Last Scan
| Scanned | 2024-05-31T19:32:07+00:00 |
| URL | https://gomotors.net/robots.txt |
| Domain IPs | 104.21.91.178, 172.67.177.29, 2606:4700:3031::6815:5bb2, 2606:4700:3032::ac43:b11d |
| Response IP | 104.21.91.178 |
| Found | Yes |
| Hash | e11a5a1be2465bf26dd48ac68b00ee85d8e4c6fee98400ea80435dbaac2bd0c3 |
| SimHash | 2e320215ca94 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *pic%3D0 |
| Disallow | *PhotoGallery.html |
| Disallow | /car-tech/* |
| Disallow | *gallery.html |
| Disallow | /timthumb/ |
| Disallow | /thumb/ |
| Disallow | /download/ |
| Disallow | /go/ |
| Disallow | /get/ |
| Disallow | /counter/ |
| Disallow | /counter.gif |
| Disallow | /boxes.php |
| Disallow | /linksphotos.txt |
| Disallow | /Mercedes_Benz/Mercedes_BenzGLK3004Matic.html%26usg%3D |
| Disallow | *?source= |
| Disallow | *?q= |
| Disallow | *?makes= |
| Disallow | /buy-car/-* |
| Disallow | /blog/wp-admin/ |
| Allow | /blog/wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gomotors.net/sitemap.xml |
| sitemap | https://gomotors.net/blog/sitemap_index.xml |