prinsenstichting.nl
robots.txt

Robots Exclusion Standard data for prinsenstichting.nl

Resource Scan

Scan Details

Site Domain prinsenstichting.nl
Base Domain prinsenstichting.nl
Scan Status Ok
Last Scan2024-11-08T19:52:00+00:00
Next Scan 2024-11-22T19:52:00+00:00

Last Scan

Scanned2024-11-08T19:52:00+00:00
URL https://prinsenstichting.nl/robots.txt
Redirect https://www.prinsenstichting.nl/robots.txt
Redirect Domain www.prinsenstichting.nl
Redirect Base prinsenstichting.nl
Domain IPs 37.97.209.184
Redirect IPs 37.97.209.184
Response IP 37.97.209.184
Found Yes
Hash f00f6599987277980af9a989f6c2640e4e06200a821379f36f11ecccdd3c6c38
SimHash 21220b474e84

Groups

*

Rule Path
Disallow /app_browsers/
Disallow /app_data/
Disallow /app_plugins/
Disallow /app_start/
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /controllers/
Disallow /fonts/
Disallow /models/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /views/

Other Records

Field Value
sitemap https://www.prinsenstichting.nl/sitemap.xml

Comments

  • Use for all search robots
  • Define the directories not to crawl
  • Define the sitemap of the site