cv.nl
robots.txt
Robots Exclusion Standard data for cv.nl
Resource Scan
Scan Details
| Site Domain | cv.nl |
| Base Domain | cv.nl |
| Scan Status | Ok |
| Last Scan | 2024-09-10T18:51:58+00:00 |
| Next Scan | 2024-09-24T18:51:58+00:00 |
Last Scan
| Scanned | 2024-09-10T18:51:58+00:00 |
| URL | https://cv.nl/robots.txt |
| Redirect | https://www.cv.nl/robots.txt |
| Redirect Domain | www.cv.nl |
| Redirect Base | cv.nl |
| Domain IPs | 13.227.254.119, 13.227.254.86, 13.227.254.95, 13.227.254.96, 2600:9000:200a:2200:0:e956:3e80:93a1, 2600:9000:200a:9000:0:e956:3e80:93a1, 2600:9000:200a:9600:0:e956:3e80:93a1, 2600:9000:200a:9800:0:e956:3e80:93a1, 2600:9000:200a:b000:0:e956:3e80:93a1, 2600:9000:200a:b200:0:e956:3e80:93a1, 2600:9000:200a:b400:0:e956:3e80:93a1, 2600:9000:200a:d400:0:e956:3e80:93a1 |
| Redirect IPs | 13.227.254.119, 13.227.254.86, 13.227.254.95, 13.227.254.96, 2600:9000:200a:4400:0:e956:3e80:93a1, 2600:9000:200a:4a00:0:e956:3e80:93a1, 2600:9000:200a:8600:0:e956:3e80:93a1, 2600:9000:200a::e956:3e80:93a1, 2600:9000:200a:b600:0:e956:3e80:93a1, 2600:9000:200a:ce00:0:e956:3e80:93a1, 2600:9000:200a:e800:0:e956:3e80:93a1, 2600:9000:200a:fc00:0:e956:3e80:93a1 |
| Response IP | 13.227.254.86 |
| Found | Yes |
| Hash | ad29e86cd602f93b517d3180df735a6c0ca48a8cdb48328c251fb282b9cf54bf |
| SimHash | 60088b4a9fa3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?title= |
| Disallow | *%26title%3D |
| Disallow | *?v= |
| Disallow | *%26v%3D |
| Disallow | *?pub= |
| Disallow | *?cid= |
| Disallow | *?reid= |
| Disallow | *?inf= |
| Disallow | *?act= |
| Disallow | *?compid= |
| Disallow | /cgi-sys/ |
| Disallow | */cancel-subscription* |
| Disallow | */manage-subscription* |
| Disallow | /api* |
| Disallow | /app/* |
| Disallow | /admin* |
| Allow | /api/media/* |
| Allow | /api/faq/* |
| Allow | /api/user/report |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cv.nl/sitemap.xml |