Log In Sign Up

nationaleonderwijsgids.nl
robots.txt

Robots Exclusion Standard data for nationaleonderwijsgids.nl

Resource Scan

Scan Details

Site Domain nationaleonderwijsgids.nl
Base Domain nationaleonderwijsgids.nl
Scan Status Ok
Last Scan2024-10-05T10:47:50+00:00
Next Scan 2024-10-12T10:47:50+00:00

Last Scan

Scanned2024-10-05T10:47:50+00:00
URL https://nationaleonderwijsgids.nl/robots.txt
Redirect http://www.nationaleonderwijsgids.nl/robots.txt
Redirect Domain www.nationaleonderwijsgids.nl
Redirect Base nationaleonderwijsgids.nl
Domain IPs 2001:4018:1100:7::59, 213.207.97.59
Redirect IPs 2001:4018:1100:7::59, 213.207.97.59
Response IP 213.207.97.59
Found Yes
Hash c8c0d01cc375fecf29ccf75427beafadfe7caf16c85d5835d3cec060daff9883
SimHash a284280d4460

Groups

*

Rule Path
Disallow /PRT/*
Disallow /paginas/index.php
Disallow /UserPics/*
Disallow /UserCVs/*
Disallow /vacaturegids/index.php
Disallow /vacaturegids/school.php
Disallow /admin/*
Disallow /metanavigatie/paginas/algemene-voorwaarden.html
Disallow /confirmations/*
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top