opbouw.nl
robots.txt

Robots Exclusion Standard data for opbouw.nl

Resource Scan

Scan Details

Site Domain opbouw.nl
Base Domain opbouw.nl
Scan Status Ok
Last Scan2024-11-17T02:51:38+00:00
Next Scan 2024-12-01T02:51:38+00:00

Last Scan

Scanned2024-11-17T02:51:38+00:00
URL https://opbouw.nl/robots.txt
Redirect https://www.opbouw.nl/robots.txt
Redirect Domain www.opbouw.nl
Redirect Base opbouw.nl
Domain IPs 37.97.209.184
Redirect IPs 37.97.209.184
Response IP 37.97.209.184
Found Yes
Hash 87290c99877dfe0e3b46ab74ba68e8e5429a6f50c52eafec4cfa92688b5b5b0a
SimHash 21301b074ea0

Groups

*

Rule Path
Disallow /app_browsers/
Disallow /app_data/
Disallow /app_plugins/
Disallow /app_start/
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /controllers/
Disallow /fonts/
Disallow /models/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /views/

Other Records

Field Value
sitemap https://www.opbouw.nl/sitemap.xml

Comments

  • Use for all search robots
  • Define the directories not to crawl
  • Define the sitemap of the site