lainehome.co.nz
robots.txt

Robots Exclusion Standard data for lainehome.co.nz

Resource Scan

Scan Details

Site Domain lainehome.co.nz
Base Domain lainehome.co.nz
Scan Status Ok
Last Scan2024-05-27T01:43:57+00:00
Next Scan 2024-06-26T01:43:57+00:00

Last Scan

Scanned2024-05-27T01:43:57+00:00
URL https://lainehome.co.nz/robots.txt
Redirect https://www.lainehome.co.nz/robots.txt
Redirect Domain www.lainehome.co.nz
Redirect Base lainehome.co.nz
Domain IPs 104.21.37.9, 172.67.202.43, 2606:4700:3034::6815:2509, 2606:4700:3037::ac43:ca2b
Redirect IPs 104.21.37.9, 172.67.202.43, 2606:4700:3034::6815:2509, 2606:4700:3037::ac43:ca2b
Response IP 172.67.202.43
Found Yes
Hash 68d23e5855cc411c6c3e434fe9af145596a9e067ddacb27de01de30d67194580
SimHash 4a12cb2305b1

Groups

*

Rule Path
Disallow /accounts

*

Rule Path
Allow /
Disallow /*?dir*
Disallow /*?order*
Disallow /*?gclid=
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=
Disallow /*?mode*
Disallow */shopby/*
Disallow /*?size_cm=*
Disallow /*?weight_filter=*
Disallow /*?litre_filter=*
Disallow /collections/*brands%3D*
Disallow /collections/*?features=*
Disallow /collections/*?colors=*
Disallow /collections/*?materials=*
Disallow /collections/*?room=*
Disallow /collections/*?price=*
Disallow /collections/*?on_sale=*
Disallow /collections/*?ranges=*
Disallow /collections/*?colour=*
Disallow /collections/*?size=*

Other Records

Field Value
sitemap https://www.lainehome.co.nz/sitemap.xml

Comments

  • Block all crawlers for /accounts
  • Allow all crawlers

Warnings

  • `host` is not a known field.