blog.kleunen.nl
robots.txt
Robots Exclusion Standard data for blog.kleunen.nl
Resource Scan
Scan Details
Site Domain | blog.kleunen.nl |
Base Domain | kleunen.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Request timed out. |
Last Scan | 2024-05-23T02:19:28+00:00 |
Next Scan | 2024-08-21T02:19:28+00:00 |
Last Successful Scan
Scanned | 2024-01-02T02:00:27+00:00 |
URL | https://blog.kleunen.nl/robots.txt |
Domain IPs | 82.197.214.151 |
Response IP | 82.197.214.151 |
Found | Yes |
Hash | 5bd72d285de50b4423f4bd8923d3672bfc33e82f6a298e2105f40d5fbc920d94 |
SimHash | 002cc9a2e1b4 |
Groups
*
Rule | Path |
---|---|
Disallow | /backup/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /grav/ |
Disallow | /logs/ |
Disallow | /system/ |
Disallow | /vendor/ |
Disallow | /user/ |
Allow | /user/pages/ |
Allow | /user/themes/ |
Allow | /user/images/ |
Allow | / |
Allow | *.css$ |
Allow | *.js$ |
Allow | /system/*.js$ |