autovandaag.nl
robots.txt
Robots Exclusion Standard data for autovandaag.nl
Resource Scan
Scan Details
Site Domain | autovandaag.nl |
Base Domain | autovandaag.nl |
Scan Status | Ok |
Last Scan | 2024-09-13T04:43:33+00:00 |
Next Scan | 2024-10-13T04:43:33+00:00 |
Last Scan
Scanned | 2024-09-13T04:43:33+00:00 |
URL | http://autovandaag.nl/robots.txt |
Domain IPs | 206.189.241.106 |
Response IP | 206.189.241.106 |
Found | Yes |
Hash | c0eb2b4bcb04648657f24997b23cb726fc57b1c39b60e3d12b1b2e72bca05bdd |
SimHash | eed30818c492 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-content/plugins/ |
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /tags/ |
Disallow | /occasions/zoeken |
Disallow | |
Disallow | /send-a-friend/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.autovandaag.nl/sitemaps/sitemap.xml |
Warnings
- 4 invalid lines.
Comments