lightonline.com.au
robots.txt

Robots Exclusion Standard data for lightonline.com.au

Resource Scan

Scan Details

Site Domain lightonline.com.au
Base Domain lightonline.com.au
Scan Status Ok
Last Scan2025-08-08T17:13:41+00:00
Next Scan 2025-09-07T17:13:41+00:00

Last Scan

Scanned2025-08-08T17:13:41+00:00
URL https://lightonline.com.au/robots.txt
Redirect https://www.lightonline.com.au/robots.txt
Redirect Domain www.lightonline.com.au
Redirect Base lightonline.com.au
Domain IPs 104.21.54.43, 172.67.223.148, 2606:4700:3035::6815:362b, 2606:4700:3035::ac43:df94
Redirect IPs 104.21.54.43, 172.67.223.148, 2606:4700:3035::6815:362b, 2606:4700:3035::ac43:df94
Response IP 104.21.54.43
Found Yes
Hash 6584521158877d0b9a6bdbdcde69d5089ca89c7e17872a27ab1f14bf46c16f29
SimHash 6980d2508c0c

Groups

*
*

Rule Path
Disallow /web/*
Disallow /tests/*
Disallow /customer/*
Disallow /sale-3/*
Disallow /*/index
Disallow /*/index/
Disallow /media/*
Disallow /cart/*
Disallow /plugin/*
Disallow /assets/*

*

Rule Path
Allow /social_instagram/

Other Records

Field Value
sitemap https://www.lightonline.com.au/sitemap.xml

Comments

  • custom
  • Our dashboard and test pages (in odoo)
  • These are indexed form old lightonline but no redirection exist