kupu.maori.nz
robots.txt
Robots Exclusion Standard data for kupu.maori.nz
Resource Scan
Scan Details
| Site Domain | kupu.maori.nz |
| Base Domain | kupu.maori.nz |
| Scan Status | Ok |
| Last Scan | 2024-08-23T05:02:40+00:00 |
| Next Scan | 2024-09-22T05:02:40+00:00 |
Last Scan
| Scanned | 2024-08-23T05:02:40+00:00 |
| URL | https://kupu.maori.nz/robots.txt |
| Domain IPs | 20.42.128.98 |
| Response IP | 20.42.128.98 |
| Found | Yes |
| Hash | dad75a8381be5d06bdf603d8e32c9e382daa86342ed7c8a3ff785bacc09dcc3e |
| SimHash | e1f0fcc24332 |
Groups
linguee+bot+(http://www.linguee.com/bot;+bot@linguee.com)
| Rule | Path |
|---|---|
| Disallow | /PDF.aspx |
| Disallow | /PDF.aspx?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /Confirm.aspx |
| Disallow | /ConfirmUnregister.aspx |
| Disallow | /Options.aspx |
| Disallow | /Pie.aspx |
| Disallow | /Test.aspx?* |
| Disallow | /Test.aspx |
| Disallow | /test |
| Disallow | /whakam%C4%81tautau |
| Disallow | /test?* |
| Disallow | /whakam%C4%81tautau?* |
| Disallow | /Kaitiaki |
| Allow | /*? |