Log In Sign Up

datawonen.nl
robots.txt

Robots Exclusion Standard data for datawonen.nl

Resource Scan

Scan Details

Site Domain datawonen.nl
Base Domain datawonen.nl
Scan Status Ok
Last Scan2024-09-15T23:03:53+00:00
Next Scan 2024-09-29T23:03:53+00:00

Last Scan

Scanned2024-09-15T23:03:53+00:00
URL https://datawonen.nl/robots.txt
Domain IPs 2a00:d00:101:950::3:2, 94.228.143.5
Response IP 94.228.143.5
Found Yes
Hash 9be99cddb939dcc1158779211f7497d53e502ad53ee0742f3ed6a02e0e680811
SimHash f910d8638596

Groups

*

Rule Path
Allow /
Allow /sitemap-index.xml
Allow /sitemap-ballroom.xml
Allow /sitemap-mosaics-1.xml
Allow /sitemap-mosaics.xml
Disallow /cms/
Disallow /dashadmin/editor
Disallow /dashadmin/preview
Disallow /zoeken
Disallow /handlers/
Disallow /login.aspx/

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://datawonen.nl/sitemap-index.xml
Back to top

Comments

  • Swing Allow Section (is overwritten after publish)
  • End Swing Allow Section
  • Swing Disallow Section (is overwritten after publish)
  • End Swing Disallow Section
  • KEEP AT BOTTOM
  • Swing Sitemap Section (is overwritten after publish)
  • End Swing Sitemap Section
Back to top