cvster.nl
robots.txt

Robots Exclusion Standard data for cvster.nl

Resource Scan

Scan Details

Site Domain cvster.nl
Base Domain cvster.nl
Scan Status Ok
Last Scan2026-02-09T12:37:57+00:00
Next Scan 2026-02-23T12:37:57+00:00

Last Scan

Scanned2026-02-09T12:37:57+00:00
URL https://cvster.nl/robots.txt
Domain IPs 104.18.0.217, 104.18.1.217, 2606:4700::6812:1d9, 2606:4700::6812:d9
Response IP 104.18.1.217
Found Yes
Hash 9b4ec1005697e019044280cc0da7e0b018e789922c27edab6e4e53c777f0844f
SimHash 4a25d858cdd2

Groups

*
ia_archiver

Rule Path
Disallow /

googlebot

Rule Path
Disallow /app/
Disallow /partners/
Disallow /orgs/

twitterbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://cvster.nl/sitemap.xml
sitemap https://cvster.nl/sitemap-image.xml