autowereld.com
robots.txt
Robots Exclusion Standard data for autowereld.com
Resource Scan
Scan Details
| Site Domain | autowereld.com |
| Base Domain | autowereld.com |
| Scan Status | Ok |
| Last Scan | 2024-10-01T21:28:47+00:00 |
| Next Scan | 2024-10-08T21:28:47+00:00 |
Last Scan
| Scanned | 2024-10-01T21:28:47+00:00 |
| URL | https://www.autowereld.com/robots.txt |
| Redirect | https://www.autoreview.nl/robots.txt |
| Redirect Domain | www.autoreview.nl |
| Redirect Base | autoreview.nl |
| Domain IPs | 128.140.81.140, 2a01:4f8:c012:81ad::1 |
| Redirect IPs | 128.140.81.140, 2a01:4f8:c012:81ad::1 |
| Response IP | 128.140.81.140 |
| Found | Yes |
| Hash | 910450eb163f5d8235815b7bf3b1b7d51f7fcc877ebf191dee1d87909d0d447d |
| SimHash | 471da8c8ff92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /assets/email |
| Disallow | /build-app |
| Disallow | /partner |
| Disallow | /private-lease/naar-deal |
| Disallow | /private-lease/api/ |
| Disallow | /*?artikel=* |
| Disallow | /*?zoeken=* |
| Disallow | /*?*merk= |
| Disallow | /*?*fotoid= |
| Disallow | /*?*p= |
| Disallow | /*?*model= |
| Disallow | /*?*redirect_to_mobile= |
| Disallow | /*?*pa= |
| Disallow | /*?*segment= |
| Disallow | /*?*letter= |
| Disallow | /high/ |
| Disallow | /imagesDB/ |
| Disallow | /index.php/ |
| Disallow | /multimedia/fotogalleries/ |
| Disallow | /1024*jpg |
| Disallow | /140*jpg |
| Disallow | /1600*jpg |
| Disallow | /200*jpg |
| Disallow | /300*jpg |
| Disallow | /400*jpg |
| Disallow | /500*jpg |
| Disallow | /600*jpg |
| Disallow | /640*jpg |
| Disallow | /700*jpg |
| Disallow | /800*jpg |
| Disallow | /900*jpg |
| Disallow | /og/*jpg |
| Disallow | /aHR0cHM6Ly93d3cu* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.autoreview.nl/sitemap.xml |
| sitemap | https://www.autoreview.nl/google-news-sitemap.xml |
| sitemap | https://www.autoreview.nl/private-lease/shops-sitemap.xml |
| sitemap | https://www.autoreview.nl/private-lease/information-sitemap.xml |
| sitemap | https://www.autoreview.nl/private-lease/cars-sitemap.xml |
| sitemap | https://www.autoreview.nl/private-lease/brands-sitemap.xml |
| sitemap | https://www.autoreview.nl/private-lease/sitemap.xml |