Log In Sign Up

lesbitubes.com
robots.txt

Robots Exclusion Standard data for lesbitubes.com

Resource Scan

Scan Details

Site Domain lesbitubes.com
Base Domain lesbitubes.com
Scan Status Ok
Last Scan2025-11-16T14:10:46+00:00
Next Scan 2025-12-16T14:10:46+00:00

Last Scan

Scanned2025-11-16T14:10:46+00:00
URL http://lesbitubes.com/robots.txt
Redirect http://www.lesbitubes.com/robots.txt
Redirect Domain www.lesbitubes.com
Redirect Base lesbitubes.com
Domain IPs 38.6.80.223
Redirect IPs 38.6.80.223
Response IP 38.6.80.223
Found Yes
Hash deb797d3a2bf9f2b2656f332e39e2a5642f01b5e2b1232b9cffb757285048185
SimHash 0a042873ee9a

Groups

*

Rule Path
Disallow /admin/
Disallow /wp-admin/
Disallow /config/
Disallow /backup/
Disallow /data/
Disallow /tmp/
Disallow /private/
Disallow /*.js
Disallow /*.css
Disallow /api/
Disallow /*?*
Allow /*?s=*
Allow /*?page=*

baiduspider

Rule Path
Allow /play/
Disallow /user/

Other Records

Field Value
crawl-delay 1

sogou

Product Comment
sogou Ëѹ·
Rule Path
Allow /play/
Disallow /user/

googlebot

Rule Path
Disallow /

yunspider

Product Comment
yunspider ÉñÂíËÑË÷
Rule Path
Disallow /

yisouspider

Product Comment
yisouspider °¢ÀïÆìÏÂÉñÂíËÑË÷ÅÀ³æ
Rule Path
Disallow /

bytespider

Product Comment
bytespider ×Ö½ÚÌø¶¯ÆìÏÂÅÀ³æ
Rule Path
Disallow /

evilbot

Product Comment
evilbot Õë¶ÔÌض¨¶ñÒâÅÀ³æ
Rule Path
Disallow /

duckduckbot

Product Comment
duckduckbot DuckDuckGoËÑË÷ÒýÇæ
Rule Path
Disallow /

applebot

Product Comment
applebot Æ»¹û¹«Ë¾¹Ù·½ÅÀ³æ
Rule Path
Disallow /

twitterbot

Product Comment
twitterbot ÍÆÌعٷ½ÅÀ³æ
Rule Path
Disallow /

facebookexternalhit

Product Comment
facebookexternalhit Meta¹Ù·½ÅÀ³æÕýÈ·Ãû³Æ
Rule Path
Disallow /

ahrefsbot

Product Comment
ahrefsbot AhrefsSEO¹¤¾ßÅÀ³æ
Rule Path
Disallow /

mj12bot

Product Comment
mj12bot MajesticSEOÅÀ³æ
Rule Path
Disallow /

semrushbot

Product Comment
semrushbot SEMRush¹¤¾ßÅÀ³æ
Rule Path
Disallow /

dotbot

Product Comment
dotbot ÄÚÈݾۺÏÅÀ³æ
Rule Path
Disallow /

yandexbot

Product Comment
yandexbot ¶íÂÞ˹YandexËÑË÷ÒýÇæ
Rule Path
Disallow /

zoominfobot

Product Comment
zoominfobot ÉÌÒµÊý¾Ý²É¼¯ÅÀ³æ
Rule Path
Disallow /

extlinksbot

Product Comment
extlinksbot ÍâÁ´¼ì²âÅÀ³æ
Rule Path
Disallow /

blexbot

Product Comment
blexbot WebÊý¾ÝÌáÈ¡ÅÀ³æ
Rule Path
Disallow /

ccbot

Product Comment
ccbot CommonCrawl»ù½ð»áÅÀ³æ
Rule Path
Disallow /

ia_archiver

Product Comment
ia_archiver AlexaÍøÕ¾ÅÅÃûÅÀ³æ
Rule Path
Disallow /

metauri

Product Comment
metauri ÔªÊý¾Ý²É¼¯ÅÀ³æ
Rule Path
Disallow /

nmap

Product Comment
nmap °²È«É¨Ã蹤¾ß
Rule Path
Disallow /

sqlmap

Product Comment
sqlmap SQL×¢È빤¾ß(ӦСд)
Rule Path
Disallow /

webzip

Product Comment
webzip ÍøÕ¾¾µÏñ¹¤¾ß
Rule Path
Disallow /

netcraftsurveyagent

Product Comment
netcraftsurveyagent ÍøÂ簲ȫµ÷²éÅÀ³æ
Rule Path
Disallow /
Disallow /.env
Disallow /phpinfo.php
Disallow /debug.php
Disallow /test.php
Disallow /vendor/
Disallow /phpmyadmin/
Back to top

Other Records

Field Value
sitemap http://www.lesbitubes.com/sitemap.xml
Back to top

Comments

  • ===== È«¾Ö»ù´¡¹æÔò =====
  • ===== °Ù¶È/360/Ëѹ·×¨ÊôÓÅ»¯ =====
  • ===== À©Õ¹ÅÀ³æºÚÃûµ¥ =====
  • ===== °²È«·À»¤ =====
Back to top

Warnings

  • 3 invalid lines.
Back to top