Log In Sign Up

touche.1studi.ru
robots.txt

Robots Exclusion Standard data for touche.1studi.ru

Resource Scan

Scan Details

Site Domain touche.1studi.ru
Base Domain 1studi.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-23T21:03:52+00:00
Next Scan 2024-06-21T21:03:52+00:00

Last Successful Scan

Scanned2022-11-07T12:53:33+00:00
URL http://touche.1studi.ru/robots.txt
Response IP 144.91.119.25
Found Yes
Hash 87b7f77a3e12f84932e9cd72d9debae83cce594f9b2650489a67d9cfa944aee5
SimHash 30b2db224d27

Groups

*

Rule Path
Disallow /?blackhole

*

Rule Path
Allow /cp/admin-ajax.php
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /my-account-2/
Disallow /activity/
Disallow /add-listing/
Disallow /cp
Disallow /*public_html/
Disallow /*index.php?
Disallow /ucp
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /cgi-bin
Disallow /incl
Disallow /apps
Disallow /assets/cache
Disallow /assets/themes
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /*/trackback
Disallow /*/comments
Disallow /archive
Disallow /category
Disallow /stat/

Other Records

Field Value
crawl-delay 120

semrushbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

semrush

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

keybot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

etaospider

Rule Path
Disallow /

applebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video
baiduspider-image

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow *

gigabot

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

keybot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

kumo

Rule Path
Disallow /

linguee

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

nutch

Rule Path
Disallow /

obot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

asterias

Rule Path
Disallow /

semanticjuice

Rule Path
Disallow /
Disallow /

semrushbot

Rule Path
Disallow /
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

woorank

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

yandex
yandeximages

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

keybot translation-search-machine

Rule Path
Disallow /
Back to top

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Sun, 09 Aug 2020 04:38:29 +0000
  • Do not modify this file, any contents will be overwritten
  • IndividualBots
  • Individual Bots
  • 80legs
  • Alibaba
  • Applebot
  • Baiduspider
  • Baidu (CN)
  • Barkrowler
  • bidswitchbot
  • BingPreview
  • BUbiNG
  • Common Crawl
  • DomainStatsBot
  • DotBot - may have to ban
  • DnyzBot - Likely won't work
  • Exabot - may have to ban
  • Ezooms
  • FemtosearchBot beat up on history.php
  • GigaBlast
  • Goo (JP)
  • Grapeshot advertising bot
  • GuzzleHttp
  • Keybot
  • The Knowledge AI
  • Stratagems Kumo
  • Linguee Bot
  • Lipperhey SEO
  • ltx71
  • mail.ru
  • MauiBot
  • MJ12bot
  • Naver (KR)
  • Nutch
  • oBot
  • PiplBot
  • PicSearth Swedish image bBot
  • Riddler
  • Scrub The Web
  • SingingFish
  • Semanticjuice
  • SemrushBot - graphs
  • SemrushBot - SEO
  • SeznamBot
  • SiteSucker
  • Slurp
  • SMTBot
  • SoGou (CN)
  • spbot - gotchas
  • woorank SEO
  • German SEO Bot CIDR ranges of 212.224.119.128/26 and 88.198.247.160/28
  • Yahoo Blogs
  • Yandex (RU)
  • Youdao (CN)
Back to top

Warnings

  • 2 invalid lines.
Back to top