btko.net
robots.txt

Robots Exclusion Standard data for btko.net

Resource Scan

Scan Details

Site Domain btko.net
Base Domain btko.net
Scan Status Ok
Last Scan2025-12-02T13:26:49+00:00
Next Scan 2025-12-09T13:26:49+00:00

Last Scan

Scanned2025-12-02T13:26:49+00:00
URL https://btko.net/robots.txt
Redirect https://www.btko.net/robots.txt
Redirect Domain www.btko.net
Redirect Base btko.net
Domain IPs 59.125.53.129
Redirect IPs 59.125.53.129
Response IP 59.125.53.129
Found Yes
Hash aaf6090f93d3eb3f8b91f8f2653f53174d835db511fef8c3dd9ef5519b86c091
SimHash 3494097abea3

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

gecko

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

test-bot

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

*

Rule Path
Allow /assets/
Allow /Pic/
Allow /*.js$
Allow /*.css$
Allow /ads.txt$
Allow /search?q=*
Disallow /chse-rotary/
Disallow /font/
Disallow /mgss/
Disallow /StockList.files/
Disallow /iptv/
Disallow /*.htm$
Disallow /*.html$
Disallow /*.php$
Disallow /*.asp$
Disallow /dispbbs
Disallow /dv_rss
Disallow /friendlist
Disallow /dispuser
Disallow /query
Disallow /ShowHot
Disallow /Show_
Disallow /ShowClass
Disallow /ShowKW
Disallow /ShowJi
Disallow /ShowJi_find
Disallow /Showtest
Disallow /MemberSSL
Disallow /dayb*
Disallow /date*
Disallow /DIY*
Disallow /*?*
Disallow /M_*
Disallow /*_new$
Disallow /summert$
Disallow /contact$
Disallow /c$
Disallow /cgPage$
Disallow /FBservice$
Disallow /p$
Disallow /P$
Disallow /Hot$
Disallow /*/Hot$
Disallow /Show-$
Disallow /k%3D$
Disallow /j%3D$

twitterbot

Rule Path
Allow /images/
Allow /Pic/

facebookexternalhit

Rule Path
Allow /images/
Allow /Pic/

Other Records

Field Value
sitemap https://www.btko.net/sitemap.xml

Comments

  • Crawlers of certain social media sites are allowed to access page markup when btko.net/images/* links are shared.