nlarbeidsinspectie.nl
robots.txt

Robots Exclusion Standard data for nlarbeidsinspectie.nl

Resource Scan

Scan Details

Site Domain nlarbeidsinspectie.nl
Base Domain nlarbeidsinspectie.nl
Scan Status Ok
Last Scan2024-11-19T04:01:51+00:00
Next Scan 2024-12-03T04:01:51+00:00

Last Scan

Scanned2024-11-19T04:01:51+00:00
URL https://nlarbeidsinspectie.nl/robots.txt
Redirect https://www.nlarbeidsinspectie.nl/robots.txt
Redirect Domain www.nlarbeidsinspectie.nl
Redirect Base nlarbeidsinspectie.nl
Domain IPs 178.22.85.166, 178.22.85.167, 178.22.85.168, 178.22.85.169, 2a00:d00:3:10::80, 2a00:d00:3:10::90, 2a00:d00:3:10::91, 2a00:d00:3:10::92
Redirect IPs 178.22.85.166, 178.22.85.167, 178.22.85.168, 178.22.85.169, 2a00:d00:3:10::80, 2a00:d00:3:10::90, 2a00:d00:3:10::91, 2a00:d00:3:10::92
Response IP 178.22.85.168
Found Yes
Hash 7cca8131ad5ca804f921abfb608757b74e56696213e5d30a3aba0f03d1b4381e
SimHash 695d5a44c911

Groups

gsa-crawler

Rule Path
Disallow /

*

Rule Path
Disallow /error/*

Other Records

Field Value
sitemap https://www.nlarbeidsinspectie.nl/nieuws-sitemap.xml