njav.nl
robots.txt

Robots Exclusion Standard data for njav.nl

Resource Scan

Scan Details

Site Domain njav.nl
Base Domain njav.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-03-01T03:03:15+00:00
Next Scan 2026-04-30T03:03:15+00:00

Last Successful Scan

Scanned2025-12-09T01:42:58+00:00
URL https://njav.nl/robots.txt
Domain IPs 104.21.7.191, 172.67.187.249, 2606:4700:3034::ac43:bbf9, 2606:4700:3035::6815:7bf
Response IP 172.67.187.249
Found Yes
Hash 1d66502904c7153c7d3ce9b14e9ff4554c62ba80954abfe5315fe74514081583
SimHash 41004c404f93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://njav.nl/sitemap_index.xml