nzbirdsonline.org.nz
robots.txt
Robots Exclusion Standard data for nzbirdsonline.org.nz
Resource Scan
Scan Details
| Site Domain | nzbirdsonline.org.nz |
| Base Domain | nzbirdsonline.org.nz |
| Scan Status | Ok |
| Last Scan | 2024-10-20T03:35:58+00:00 |
| Next Scan | 2024-11-19T03:35:58+00:00 |
Last Scan
| Scanned | 2024-10-20T03:35:58+00:00 |
| URL | https://nzbirdsonline.org.nz/robots.txt |
| Redirect | https://www.nzbirdsonline.org.nz/robots.txt |
| Redirect Domain | www.nzbirdsonline.org.nz |
| Redirect Base | nzbirdsonline.org.nz |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.61, 76.76.21.9 |
| Response IP | 76.76.21.93 |
| Found | Yes |
| Hash | 677ca1ff5d16e8932676414999ece020017f9c44e587003d1051401d2fc8f0a8 |
| SimHash | e9205cb2c5c0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /api/ |
| Disallow | /checklist |
| Disallow | /conservation |
| Disallow | /idBird |
| Disallow | /location |
| Disallow | /searchGroup |
| Disallow | /searchName |
| Disallow | /searchOrder |
| Disallow | /_next/ |
| Disallow | /api/ |
| Disallow | /public/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://nzbirdsonline.org.nz/sitemap.xml |