wk.nl
robots.txt

Robots Exclusion Standard data for wk.nl

Resource Scan

Scan Details

Site Domain wk.nl
Base Domain wk.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2026-01-14T04:48:02+00:00
Next Scan 2026-02-13T04:48:02+00:00

Last Successful Scan

Scanned2025-11-23T04:30:44+00:00
URL https://wk.nl/robots.txt
Redirect https://www.wk.nl/robots.txt
Redirect Domain www.wk.nl
Redirect Base wk.nl
Domain IPs 217.18.70.169
Redirect IPs 217.18.70.169
Response IP 217.18.70.169
Found Yes
Hash c62bd962e928cda2f61a290f08bb40e83ce167752f90a34a13fe4fa488bfb2d6
SimHash 7900b8534591

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.wk.nl/sitemap.xml

Comments

  • XML Sitemap & Google News version 5.3.3 - https://status301.net/wordpress-plugins/xml-sitemap-feed/