Log In Sign Up

labsglass.com
robots.txt

Robots Exclusion Standard data for labsglass.com

Resource Scan

Scan Details

Site Domain labsglass.com
Base Domain labsglass.com
Scan Status Ok
Last Scan2026-01-24T01:22:19+00:00
Next Scan 2026-01-31T01:22:19+00:00

Last Scan

Scanned2026-01-24T01:22:19+00:00
URL https://labsglass.com/robots.txt
Domain IPs 104.21.50.73, 172.67.158.205, 2606:4700:3035::6815:3249, 2606:4700:3035::ac43:9ecd
Response IP 104.21.50.73
Found Yes
Hash ce535e7a56e4d40039cc90fdb74d3b5c879be3c7ab48ee408cb853295e46712d
SimHash 3a9f81222df2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /*?add-to-cart=
Disallow /*?*add-to-cart=
Allow /blog/
Allow /products/
Allow /categories/
Allow /

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

chatgpt

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

googlebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

googleother

Rule Path
Allow /

facebookbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

amazonbot

Rule Path
Allow /

amazon-adsbot

Rule Path
Allow /

applebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

bytespider

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-ai

Rule Path
Allow /

youbot

Rule Path
Allow /

mistralbot

Rule Path
Allow /

neevabot

Rule Path
Allow /

diffbot

Rule Path
Allow /

petalbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

deepseekbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

duckassistbot

Rule Path
Allow /

dataforseo

Rule Path
Allow /

serpapibot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

sogou

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

commoncrawl

Rule Path
Allow /

mj12bot
pinterest

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://labsglass.com/sitemap_index.xml
sitemap https://labsglass.com/sitemap.xml
sitemap https://labsglass.com/product-sitemap1.xml
sitemap https://labsglass.com/product-sitemap2.xml
sitemap https://labsglass.com/product-sitemap3.xml
sitemap https://labsglass.com/product-sitemap4.xml
sitemap https://labsglass.com/product-sitemap5.xml
sitemap https://labsglass.com/product-sitemap6.xml
sitemap https://labsglass.com/product-sitemap7.xml
sitemap https://labsglass.com/page-sitemap.xml
Back to top

Comments

  • This file is automatically added by Rank Math SEO plugin to help a website index better
  • More info: https://rankmath.com/?utm_source=Plugin&utm_medium=Robots&utm_campaign=WP
  • Allow search engines to crawl important pages
  • --- OpenAI & Affiliates ---
  • --- Anthropic / Claude ---
  • --- Google AI & General Search ---
  • --- Meta / Facebook ---
  • --- Amazon ---
  • --- Apple ---
  • --- Baidu / China ---
  • --- ByteDance / TikTok ---
  • --- Perplexity AI ---
  • --- You.com ---
  • --- Mistral AI ---
  • --- Neeva AI (by Snowflake) ---
  • --- Diffbot ---
  • --- Petal (Huawei Search) ---
  • --- Common Crawl / CCBot ---
  • --- DeepSeek AI ---
  • --- DuckDuckGo / AI Chat ---
  • --- Others / Aggregators ---
  • --- Archive / Research ---
Back to top