dealerwebsite.co.uk
robots.txt
Robots Exclusion Standard data for dealerwebsite.co.uk
Resource Scan
Scan Details
| Site Domain | dealerwebsite.co.uk |
| Base Domain | dealerwebsite.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-18T01:53:18+00:00 |
| Next Scan | 2024-11-17T01:53:18+00:00 |
Last Scan
| Scanned | 2024-10-18T01:53:18+00:00 |
| URL | https://www.dealerwebsite.co.uk/robots.txt |
| Domain IPs | 18.155.68.21, 18.155.68.37, 18.155.68.46, 18.155.68.62, 2600:9000:23d2:2c00:17:8ba5:72c0:93a1, 2600:9000:23d2:4000:17:8ba5:72c0:93a1, 2600:9000:23d2:5000:17:8ba5:72c0:93a1, 2600:9000:23d2:5400:17:8ba5:72c0:93a1, 2600:9000:23d2:5c00:17:8ba5:72c0:93a1, 2600:9000:23d2:6e00:17:8ba5:72c0:93a1, 2600:9000:23d2:b600:17:8ba5:72c0:93a1, 2600:9000:23d2:ce00:17:8ba5:72c0:93a1 |
| Response IP | 18.155.68.62 |
| Found | Yes |
| Hash | d7328ad25615e55a690a4051f489f629ed8430c630414036990b06e6211fa098 |
| SimHash | 810dd7414d43 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */online-deposits/* |
| Disallow | */site/* |
| Disallow | */enquiry/* |
| Disallow | */new-car-variants/* |
| Disallow | */book-a-test-drive/* |
| Disallow | */api/* |
| Disallow | */ajax/* |
| Disallow | */search/* |
| Disallow | *order%3D* |
| Disallow | */vehicle-search/* |
| Disallow | */new-car-configurator/* |
| Disallow | */data-preferences/* |
| Disallow | */online-payments/* |
| Disallow | */all-vehicles/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://performancetest.dealerwebsite.co.uk/sitemap.xml.gz |
Comments