redcross.org.nz
robots.txt

Robots Exclusion Standard data for redcross.org.nz

Resource Scan

Scan Details

Site Domain redcross.org.nz
Base Domain redcross.org.nz
Scan Status Ok
Last Scan2024-10-20T08:07:18+00:00
Next Scan 2024-11-19T08:07:18+00:00

Last Scan

Scanned2024-10-20T08:07:18+00:00
URL https://redcross.org.nz/robots.txt
Redirect https://www.redcross.org.nz:443/robots.txt
Redirect Domain www.redcross.org.nz
Redirect Base redcross.org.nz
Domain IPs 13.211.193.192, 3.105.16.19, 3.25.11.8
Redirect IPs 18.155.68.125, 18.155.68.42, 18.155.68.44, 18.155.68.63
Response IP 18.155.68.125
Found Yes
Hash 6dfcfbed07b40f93fcc17a3cf654dc5df5066f10190a2d14d9c932e54201c155
SimHash e82c5d22e296

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /django-admin/
Disallow /api/
Disallow /*thank-you
Disallow /*success
Disallow /*corporate-bookings
Disallow /cf/*
Disallow /googledb*
Disallow /cart/*

Other Records

Field Value
sitemap https://www.redcross.org.nz/sitemap.xml

Comments

  • www.robotstxt.org/
  • Allow crawling of all content