omaweetraad.nl
robots.txt

Robots Exclusion Standard data for omaweetraad.nl

Resource Scan

Scan Details

Site Domain omaweetraad.nl
Base Domain omaweetraad.nl
Scan Status Ok
Last Scan2024-11-16T08:22:09+00:00
Next Scan 2024-11-23T08:22:09+00:00

Last Scan

Scanned2024-11-16T08:22:09+00:00
URL https://omaweetraad.nl/robots.txt
Domain IPs 162.159.140.104, 162.159.140.160, 172.66.0.102, 172.66.0.158, 2606:4700:7::66, 2606:4700:7::9e, 2a06:98c1:58::66, 2a06:98c1:58::9e
Response IP 172.66.0.158
Found Yes
Hash 6305f61310d004d415e1dd7bce2036718901661c3c059d8f0da5545b05cd15dd
SimHash 2264b1c5f7b2

Groups

*

Rule Path
Disallow /admin/*
Disallow /csrf
Disallow /edit/*
Disallow /forms/*
Disallow /honeypot

Other Records

Field Value
sitemap https://omaweetraad.nl/sitemap.xml

Comments

  • Robots file for Oma Weet Raad
  • For all user agents out there (shout out)
  • Exclude admin, edit and forms
  • Sitemaps