Log In Sign Up

olightstore.com.au
robots.txt

Robots Exclusion Standard data for olightstore.com.au

Resource Scan

Scan Details

Site Domain olightstore.com.au
Base Domain olightstore.com.au
Scan Status Ok
Last Scan2024-09-21T22:20:08+00:00
Next Scan 2024-10-21T22:20:08+00:00

Last Scan

Scanned2024-09-21T22:20:08+00:00
URL https://www.olightstore.com.au/robots.txt
Domain IPs 108.157.254.109, 108.157.254.115, 108.157.254.54, 108.157.254.70, 2600:9000:2753:1200:9:6e64:9900:93a1, 2600:9000:2753:1600:9:6e64:9900:93a1, 2600:9000:2753:2400:9:6e64:9900:93a1, 2600:9000:2753:4e00:9:6e64:9900:93a1, 2600:9000:2753:5000:9:6e64:9900:93a1, 2600:9000:2753:5800:9:6e64:9900:93a1, 2600:9000:2753:7200:9:6e64:9900:93a1, 2600:9000:2753:c000:9:6e64:9900:93a1
Response IP 108.157.254.115
Found Yes
Hash 4756b94e3b58b9a191d350b0e0b32456b7cb5a776ab6a389016d9db53ccc8d0a
SimHash 7dfc8f9b8ed9

Groups

*

Rule Path
Disallow /review/product/
Disallow /html?*
Disallow /?gclid*
Disallow /?olinkid*
Disallow /?ref*
Disallow /?wbraid
Disallow /*?id=*
Disallow /user
Disallow /error
Disallow /pay
Disallow /cart
Disallow /register
Disallow /expired
Disallow /invalidation.html
Disallow /detail.html?*
Disallow /catalogsearch/
Disallow /*?limit=*
Disallow /*?q=*
Disallow /*?_q=*
Disallow /*?f=*
Disallow /*?mode=grid*
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.ico
Allow /*.svg
Allow /*.webp
Allow /*.pdf
Allow /*.xml
Allow /*.rss
Allow /*.css
Allow /*.js
Allow /*.json
Back to top

Other Records

Field Value
sitemap https://www.olightstore.com.au/sitemap_listing.xml
sitemap https://www.olightstore.com.au/sitemap_article.xml
sitemap https://www.olightstore.com.au/sitemap_listing_category.xml
sitemap https://www.olightstore.com.au/sitemap_blog_category.xml
sitemap https://www.olightstore.com.au/sitemap_tag.xml
Back to top

Comments

  • Allow search crawlers to discover the sitemap
  • CSS, JS, Images, Files
Back to top