taku.nzqa.govt.nz
robots.txt

Robots Exclusion Standard data for taku.nzqa.govt.nz

Resource Scan

Scan Details

Site Domain taku.nzqa.govt.nz
Base Domain nzqa.govt.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-15T09:48:38+00:00
Next Scan 2025-03-17T09:48:38+00:00

Last Successful Scan

Scanned2024-12-25T09:34:42+00:00
URL https://taku.nzqa.govt.nz/robots.txt
Domain IPs 13.227.254.37, 13.227.254.60, 13.227.254.7, 13.227.254.98, 2600:9000:200a:2800:e:fab2:ee80:93a1, 2600:9000:200a:2c00:e:fab2:ee80:93a1, 2600:9000:200a:3400:e:fab2:ee80:93a1, 2600:9000:200a:d400:e:fab2:ee80:93a1, 2600:9000:200a:e000:e:fab2:ee80:93a1, 2600:9000:200a:ea00:e:fab2:ee80:93a1, 2600:9000:200a:ee00:e:fab2:ee80:93a1, 2600:9000:200a:f000:e:fab2:ee80:93a1
Response IP 13.227.254.7
Found Yes
Hash e41bf25bb89275d09a538d99f36aed8c8969f1a726c0513fd5ae9c68ce866ccc
SimHash 6468dc7084b7

Groups

*

Rule Path
Disallow /admin
Disallow /Security/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

swiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Comments

  • Sitemap: https://www.example.com/sitemap.xml