dionsmp.nl
robots.txt

Robots Exclusion Standard data for dionsmp.nl

Resource Scan

Scan Details

Site Domain dionsmp.nl
Base Domain dionsmp.nl
Scan Status Ok
Last Scan2026-02-02T00:20:26+00:00
Next Scan 2026-03-04T00:20:26+00:00

Last Scan

Scanned2026-02-02T00:20:26+00:00
URL https://dionsmp.nl/robots.txt
Redirect https://www.dionsmp.nl/robots.txt
Redirect Domain www.dionsmp.nl
Redirect Base dionsmp.nl
Domain IPs 216.198.79.1
Redirect IPs 216.198.79.1, 64.29.17.1
Response IP 64.29.17.1
Found Yes
Hash 66ff53f1fc46473a87609a887d65f6146a1f75304ebb8319fd3820841ac29133
SimHash 410c5c208d12

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/

Other Records

Field Value
sitemap https://dionsmp.nl/sitemap.xml

Comments

  • Block common crawl paths (example)