internetvergelijk.nl
robots.txt
Robots Exclusion Standard data for internetvergelijk.nl
Resource Scan
Scan Details
| Site Domain | internetvergelijk.nl |
| Base Domain | internetvergelijk.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-13T23:55:34+00:00 |
| Next Scan | 2024-11-20T23:55:34+00:00 |
Last Scan
| Scanned | 2024-11-13T23:55:34+00:00 |
| URL | https://internetvergelijk.nl/robots.txt |
| Redirect | https://www.internetvergelijk.nl/robots.txt |
| Redirect Domain | www.internetvergelijk.nl |
| Redirect Base | internetvergelijk.nl |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.241, 76.76.21.98 |
| Response IP | 76.76.21.142 |
| Found | Yes |
| Hash | 63edfb3da25e813ae55b252c43f23dd9c6ba1ef987179074b62d7a3fc5c79544 |
| SimHash | 129c7540c920 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /?s=* |
| Disallow | *%26p%3D* |
| Disallow | /search* |
| Disallow | /search/* |
| Disallow | *%26preview%3D* |
| Disallow | /readme.txt |
| Disallow | /naar/ |
| Disallow | /wp/wp-admin/ |
| Allow | /wp/wp-admin/admin-ajax.php |
| Allow | /wp/wp-admin/load-scripts.php |
| Allow | /wp/wp-admin/load-styles.php |
| Allow | /wp/wp-admin/admin-ajax.php |
Warnings
- 4 invalid lines.