Log In Sign Up

stovet.rs
robots.txt

Robots Exclusion Standard data for stovet.rs

Resource Scan

Scan Details

Site Domain stovet.rs
Base Domain stovet.rs
Scan Status Ok
Last Scan2024-10-30T02:58:15+00:00
Next Scan 2024-11-29T02:58:15+00:00

Last Scan

Scanned2024-10-30T02:58:15+00:00
URL https://stovet.rs/robots.txt
Domain IPs 176.9.89.209
Response IP 176.9.89.209
Found Yes
Hash daae758ac2000d35f0fea2bf068d53eeca91de7e6e3edcfb5e3e69e57471057e
SimHash 2c545b92e1db

Groups

adsbot-google
adsbot-google-mobile-apps
adidxbot
applebot
applenewsbot
baiduspider
baiduspider-image
bingbot
bingpreview
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebot
feedly
findxbot
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
mojeekbot
msnbot
msnbot-media
orangebot
plukkie
qwantify
rambler
seznambot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
sputnikbot
teoma
twitterbot
wotbox
yacybot
yandex
yandexmobilebot
yeti
yoozbot
youdaobot

Rule Path
Disallow /stats/
Disallow

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.stovet.rs/sitemap.xml
Back to top

Comments

  • ROBOTS.TXT
  • Updates can be retrieved from: https://github.com/jonasjacek/robots.txt
  • This document is licensed with a CC BY-NC-SA 4.0 license.
  • Last update: 2017-04-26
Back to top

Warnings

  • 3 invalid lines.
Back to top