verus.nl
robots.txt

Robots Exclusion Standard data for verus.nl

Resource Scan

Scan Details

Site Domain verus.nl
Base Domain verus.nl
Scan Status Ok
Last Scan5/19/2025, 5:54:42 PM
Next Scan 6/2/2025, 5:54:42 PM

Last Scan

Scanned5/19/2025, 5:54:42 PM
URL https://verus.nl/robots.txt
Domain IPs 104.26.0.147, 104.26.1.147, 172.67.74.64, 2606:4700:20::681a:193, 2606:4700:20::681a:93, 2606:4700:20::ac43:4a40
Response IP 104.26.1.147
Found Yes
Hash ef6ca0f046f70b2d4462a162cb0a8ff1b3d06cc85443b0170a1b409fad50ef62
SimHash 21701d526f93

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://verus.nl/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://verus.nl/
  • live - don't allow web crawlers to index cpresources/ or vendor/