semki.nl
robots.txt
Robots Exclusion Standard data for semki.nl
Resource Scan
Scan Details
Site Domain | semki.nl |
Base Domain | semki.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-05-28T08:07:30+00:00 |
Next Scan | 2024-08-26T08:07:30+00:00 |
Last Successful Scan
Scanned | 2022-10-11T13:32:33+00:00 |
URL | https://semki.nl/robots.txt |
Response IP | 104.21.70.193, 172.67.138.204 |
Found | Yes |
Hash | d6c269d7dd8594cd995ab6e0af411ee65840eb61fb5113aa6d4ad693cb080380 |
SimHash | 0307744a6cd0 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /about.html/ |
Disallow | /contact.html/ |
Disallow | /ServicesCase.html/ |
Disallow | /js/pro.js |
Disallow | /data/ |
Disallow | /themes/ |
Disallow | /img/ |
Disallow | /imgs/ |
Disallow | /css/ |
Disallow | /images/ |
Disallow | /js/ |
Disallow | /skin/ |
Disallow | /static/ |
Disallow | /pages/ |
Disallow | /inc/ |
Disallow | /incweigai/ |
Disallow | /products/ |
Disallow | /project/ |
Disallow | /solutions/ |
Disallow | /cases.html |
Disallow | /contact.html |
Disallow | /products.html |
Other Records
Field | Value |
---|---|
sitemap | https://semki.nl/sitemap.xml |