glasseslit.com
robots.txt

Robots Exclusion Standard data for glasseslit.com

Resource Scan

Scan Details

Site Domain glasseslit.com
Base Domain glasseslit.com
Scan Status Ok
Last Scan2024-09-13T03:07:11+00:00
Next Scan 2024-10-13T03:07:11+00:00

Last Scan

Scanned2024-09-13T03:07:11+00:00
URL https://glasseslit.com/robots.txt
Redirect https://www.glasseslit.com/robots.txt
Redirect Domain www.glasseslit.com
Redirect Base glasseslit.com
Domain IPs 47.252.84.198
Redirect IPs 47.252.84.198
Response IP 47.252.84.198
Found Yes
Hash 5bea85857e486cd85605a549d39e5e1c5681298a298b4e809146cb77dbfeaaef
SimHash 2b0610158221

Groups

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

semrushbot
ahrefsbot

Rule Path
Disallow /

newspaper

Rule Path
Disallow /

newspaper/0.2.8

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-requests/2.25.1

Rule Path
Disallow /

python-requests/2.26.0

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

pinterestbot/1.0

Rule Path
Disallow /

duckduckbot/1.1

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

coccocbot-web/1.0

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

domainstatsbot/1.0

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /ajax/
Disallow /Aqbm/
Disallow /errors/
Disallow /js/
Disallow /login
Disallow /login/
Disallow /local/search/
Disallow /Public/admin/
Disallow /Public/auth/
Disallow /Public/code_doc/
Disallow /Public/css/
Disallow /Public/css_mobile/
Disallow /Public/csss/
Disallow /Public/fonts/
Disallow /Public/images/
Disallow /Public/js/
Disallow /Public/js_mobile/
Disallow /Public/jss/
Disallow /messages/
Disallow /require/
Disallow /TLAdmin/Public/login
Disallow /aboutus
Disallow /balance
Disallow /changepwd
Disallow /checkout
Disallow /checkout/
Disallow /checkout/cart/
Disallow /confirmpassword
Disallow /contactus
Disallow /coupons
Disallow /customer/account/
Disallow /customize/
Disallow /default/
Disallow /firecheckout/
Disallow /forgetpassword
Disallow /helpinfo/
Disallow /index/
Disallow /indexed/
Disallow /index.php/
Disallow /index*.php
Disallow /~joe/stuff/
Disallow /js/
Disallow /KidsGlasses.php
Disallow /login
Disallow /login/
Disallow /login?url=
Disallow /login?url=*
Disallow /newsletter/
Disallow /orderlist
Disallow /payment
Disallow /payment/
Disallow /payment*
Disallow /payment?n=*
Disallow /point
Disallow /prescription
Disallow /PrescriptionGlasses.php
Disallow /product/
Disallow /Product/
Disallow /producttags/
Disallow /review/
Disallow /sales/
Disallow /search/
Disallow /search?*
Disallow /selectlenses
Disallow /selectlenses?ccode=*
Disallow /selectlenses*
Disallow /shipping
Disallow /shoppingcart
Disallow /TLAdmin
Disallow /TLAdmin*
Disallow /TLAdmin/
Disallow /TLAdmin/*
Disallow /tag/
Disallow /userinfo
Disallow /video/
Disallow /wishlist/
Disallow /*.css$
Disallow /*/filter/
Disallow /*.js$
Disallow /*?p=*
Disallow /*?p=*&
Disallow /*.php$
Disallow /*result/?q*
Disallow /rss*
Disallow /*.gif$
Disallow /*.psd$
Disallow /*.php
Disallow /*.php$
Disallow /error_log
Disallow /image
Disallow /private_file.html
Disallow /STATUS.txt
Disallow /~joe/
Disallow /~joe/junk.html
Disallow /~joe/foo.html
Disallow /~joe/bar.html
Disallow /popup/
Disallow /popup_image
Disallow /tag/
Disallow /m.glasseslit/home/
Disallow /769941.com/*
Disallow /8153718.com/*
Disallow /8153852.com/*
Disallow /8153997.com/*
Disallow /sdfhu1.com/*

Other Records

Field Value
sitemap https://www.glasseslit.com/sitemap.xml

Comments

  • Directories
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Files

Warnings

  • 1 invalid line.