larent.co.nz
robots.txt

Robots Exclusion Standard data for larent.co.nz

Resource Scan

Scan Details

Site Domain larent.co.nz
Base Domain larent.co.nz
Scan Status Ok
Last Scan2024-09-07T13:29:38+00:00
Next Scan 2024-10-07T13:29:38+00:00

Last Scan

Scanned2024-09-07T13:29:38+00:00
URL https://larent.co.nz/robots.txt
Domain IPs 52.202.58.6
Response IP 52.202.58.6
Found Yes
Hash ad5124c929b6da7d60dfcbefda7722780e5584702f02b4a64c14a814efd626ff
SimHash 610c9842e990

Groups

mj12bot

Rule Path
Disallow /*auth$
Disallow /*/login

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Disallow /*auth$
Disallow /*/login

Other Records

Field Value
crawl-delay 20

semrushbot

Rule Path
Disallow /*auth$
Disallow /*/login

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /*auth$

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://larent.co.nz/sitemap.xml.gz