treemarkables.nz
robots.txt

Robots Exclusion Standard data for treemarkables.nz

Resource Scan

Scan Details

Site Domain treemarkables.nz
Base Domain treemarkables.nz
Scan Status Ok
Last Scan2025-09-26T15:58:13+00:00
Next Scan 2025-10-03T15:58:13+00:00

Last Scan

Scanned2025-09-26T15:58:13+00:00
URL https://treemarkables.nz/robots.txt
Domain IPs 34.111.179.208
Response IP 34.111.179.208
Found Yes
Hash 0426ea8ff21b645485286b2d91f765dcd03337a9b317843d73772024fa8a339f
SimHash ce184a52c4e5

Groups

*

Rule Path
Allow /
Allow /tree-removal
Allow /tree-pruning
Allow /stump-grinding
Allow /hedge-trimming
Allow /blog
Allow /blog/*
Disallow /admin/
Disallow /api/
Disallow /private/
Allow /sitemap.xml

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.treemarkables.co.nz/sitemap.xml

Comments

  • Robots.txt for Treemarkables - Professional Tree Removal Services Gisborne
  • Website: https://www.treemarkables.co.nz
  • Allow access to all pages and resources
  • Block access to admin/private areas (if any in future)
  • Explicitly allow sitemap access (2025 Google Search Console fix)
  • XML Sitemap location for search engines
  • Crawl delay (optional - be respectful to search engines)