omaweetraad.nl
robots.txt

Robots Exclusion Standard data for omaweetraad.nl

Resource Scan

Scan Details

Site Domain omaweetraad.nl
Base Domain omaweetraad.nl
Scan Status Ok
Last Scan2024-09-21T06:53:03+00:00
Next Scan 2024-09-28T06:53:03+00:00

Last Scan

Scanned2024-09-21T06:53:03+00:00
URL https://omaweetraad.nl/robots.txt
Domain IPs 104.21.13.86, 172.67.132.165, 2606:4700:3033::6815:d56, 2606:4700:3033::ac43:84a5
Response IP 104.21.13.86
Found Yes
Hash 6305f61310d004d415e1dd7bce2036718901661c3c059d8f0da5545b05cd15dd
SimHash 2264b1c5f7b2

Groups

*

Rule Path
Disallow /admin/*
Disallow /csrf
Disallow /edit/*
Disallow /forms/*
Disallow /honeypot

Other Records

Field Value
sitemap https://omaweetraad.nl/sitemap.xml

Comments

  • Robots file for Oma Weet Raad
  • For all user agents out there (shout out)
  • Exclude admin, edit and forms
  • Sitemaps