djvault.nl
robots.txt

Robots Exclusion Standard data for djvault.nl

Resource Scan

Scan Details

Site Domain djvault.nl
Base Domain djvault.nl
Scan Status Ok
Last Scan2026-01-01T07:19:44+00:00
Next Scan 2026-01-31T07:19:44+00:00

Last Scan

Scanned2026-01-01T07:19:44+00:00
URL https://djvault.nl/robots.txt
Domain IPs 104.21.96.138, 172.67.181.163, 2606:4700:3034::ac43:b5a3, 2606:4700:3037::6815:608a
Response IP 104.21.96.138
Found Yes
Hash 9f1b5ae16e6d3d472c9bc27102dcd10bd12a613a525dedf42bd5f7ab1a2f942a
SimHash 6000ca02a3a2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /uploads/wpo-plugins-tables-list.json