nieuwnieuws.nl
robots.txt
Robots Exclusion Standard data for nieuwnieuws.nl
Resource Scan
Scan Details
Site Domain | nieuwnieuws.nl |
Base Domain | nieuwnieuws.nl |
Scan Status | Ok |
Last Scan | 2024-09-17T09:45:03+00:00 |
Next Scan | 2024-09-24T09:45:03+00:00 |
Last Scan
Scanned | 2024-09-17T09:45:03+00:00 |
URL | https://nieuwnieuws.nl/robots.txt |
Redirect | https://www.nieuwnieuws.nl/robots.txt |
Redirect Domain | www.nieuwnieuws.nl |
Redirect Base | nieuwnieuws.nl |
Domain IPs | 185.121.92.184 |
Redirect IPs | 185.121.92.184 |
Response IP | 185.121.92.184 |
Found | Yes |
Hash | 01b99cd090c0467f0588dbb73edc5d7905767113760a27f529d77f9d4b964e4c |
SimHash | f0b43e84af92 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /stats/ |
Disallow | /cp/ |
Disallow | /email/ |
Disallow | /app/ |
Disallow | /_comments/ |
Disallow | /_components/ |
Disallow | /_includes/ |
Disallow | /_layout/ |
Disallow | /async/ |