kluswijs.nl
robots.txt

Robots Exclusion Standard data for kluswijs.nl

Resource Scan

Scan Details

Site Domain kluswijs.nl
Base Domain kluswijs.nl
Scan Status Ok
Last Scan2025-02-21T23:53:43+00:00
Next Scan 2025-03-23T23:53:43+00:00

Last Scan

Scanned2025-02-21T23:53:43+00:00
URL https://kluswijs.nl/robots.txt
Redirect https://www.kluswijs.nl/robots.txt
Redirect Domain www.kluswijs.nl
Redirect Base kluswijs.nl
Domain IPs 91.216.141.200
Redirect IPs 91.216.141.200
Response IP 91.216.141.200
Found Yes
Hash f4e28931d1788c19777bffbe03315b67aa1d1dcc6e123008a611b05e126be91b
SimHash cb7cc402ea93

Groups

mj12bot
blexbot
ahrefsbot
bubing
yandex
dotbot
pingdom
spbot
krzana-rss-bot
ucmore crawler app
velenpublicwebcrawler
seekport crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kluswijs.nl/sitemap.xml