zanobia.me
robots.txt

Robots Exclusion Standard data for zanobia.me

Resource Scan

Scan Details

Site Domain zanobia.me
Base Domain zanobia.me
Scan Status Ok
Last Scan2024-11-05T14:58:19+00:00
Next Scan 2024-12-05T14:58:19+00:00

Last Scan

Scanned2024-11-05T14:58:19+00:00
URL https://zanobia.me/robots.txt
Domain IPs 104.21.47.36, 172.67.170.90, 2606:4700:3035::6815:2f24, 2606:4700:3037::ac43:aa5a
Response IP 172.67.170.90
Found Yes
Hash 57fd24687da4c3bcaa8bcc7b94430110f4ff6c639275817e3962f7766aabf699
SimHash 26219c1461f9

Groups

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
applebot
applenewsbot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
bingbot
bingpreview
bublupbot
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebot
feedly
findxbot
gooblog
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
mojeekbot
msnbot
msnbot-media
orangebot
pinterest
plukkie
qwantify
rambler
seznambot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
sputnikbot
teoma
twitterbot
wotbox
yacybot
yandex
yandexmobilebot
yeti
yioopbot
yoozbot
youdaobot

Rule Path
Disallow

*

Rule Path
Disallow /*.html$
Disallow /*.php$
Disallow /*.htm$
Disallow /*php-
Disallow /*.html
Disallow /*.php
Disallow /*.htm
Disallow /collections/*
Disallow /contact/repair-mainte/
Disallow /shopdetail/*
Disallow /*/?utm_source=*&utm_medium=*&utm_campaign=*
Disallow /brand-list/*
Disallow /brand-list
Disallow /product/*
Disallow /*keyword/*
Disallow /9873bxrr9502
Disallow /9309fwvm2785
Disallow /9291utwz4932
Disallow /909dpvh6803
Disallow /8370hwwi76260ywj15
Disallow /7000rabketidm74grt
Disallow /6699uflb4857
Disallow /59212kjmjetidm7
Disallow /58412imimetidm91q
Disallow /58198ggtoetidm81k
Disallow /57846kjmjetid
Disallow /57808rtnvetidm96krx
Disallow /57652ycdcetidm9
Disallow /55882xbhfetid
Disallow /55624qdpqetidm88kqx
Disallow /54837wxfc7441
Disallow /52766xbhfetidm49mhb
Disallow /52524azwn80790eav93
Disallow /5092dzuoetidm3
Disallow /50404dmmletidm1
Disallow /50013flad8327
Disallow /47614wbowetidm54i
Disallow /45328dprqetidm99kdx
Disallow /44742wxfc47024w
Disallow /43578gmycitems/*
Disallow /42224kjmjetid
Disallow /41866pngretid
Disallow /41644ggtoetidm8
Disallow /40912yqlxetidm48oyb
Disallow /39592vghjetidm43uvh
Disallow /38290wsppetid
Disallow /38200vghjetidm93gvt
Disallow /37918enkaetidm26k
Disallow /36112nmwfetidm26ynl
Disallow /36074vdtnetidm8
Disallow /35589mzddetidm4
Disallow /35068wlyletidm9
Disallow /33952toobetidm51wtj
Disallow /33495ezmm97324h
Disallow /32912ggtoetid
Disallow /29782aojpetidm14m
Disallow /2855vexz91361vzh
Disallow /28034enaretidm7
Disallow /27848wlzcetid
Disallow /27438dfcg3349
Disallow /27130cagoetid
Disallow /2690ggtoetidm8
Disallow /26672enkaetid
Disallow /26272mrqjetidm67mmz
Disallow /26050ebjxetid
Disallow /25034evbbetidm6
Disallow /24890yzjcetidm2
Disallow /23700drhb2911
Disallow /2070kdraetid
Disallow /2024/02/26/mostbet-26-6/
Disallow /18988enaretidm8
Disallow /18610toobetid
Disallow /16724nmwfetidm36g
Disallow /16526ebjxetidm55qjf
Disallow /16390evbbetidm69k
Disallow /16352kjmjetid
Disallow /1623nldlitem/10191
Disallow /16048yzjcetidm93gyt
Disallow /15394vdtnetid
Disallow /15139xhyvitem/12383
Disallow /14866dprqetid
Disallow /14648wlyletid
Disallow /14524kjmjetidm4
Disallow /13864ebjxetidm27get
Disallow /13798dzuoetidm79s
Disallow /13690dprqetid
Disallow /13624xslgetidm27axn
Disallow /12272drhbitem/79971ad
Disallow /11636mrqjetidm25o
Disallow /11224gmycetidm72sgf
Disallow /10636pngretidm8
Disallow /13605mzddetid
Disallow /46076hiimitem/76966
Disallow /44354ezmmitem/117

Other Records

Field Value
sitemap http://www.zanobia.me/sitemap.xml

Comments

  • so.com chinese search engine
  • google.com landing page quality checks
  • google.com app resource fetcher
  • bing ads bot
  • apple.com search engine
  • baidu.com chinese search engine
  • bing.com international search engine
  • bublup.com suggestion/search engine
  • commoncrawl.org open repository of web crawl data
  • cliqz.com german in-product search engine
  • coccoc.com vietnamese search engine
  • daum.net korean search engine
  • dazoo.fr french search engine
  • deusu.de german search engine
  • duckduckgo.com international privacy search engine
  • eurip.com european search engine
  • exploratodo.com latin search engine
  • facebook.com social network
  • feedly.com feed fetcher
  • findx.com european search engine
  • goo.ne.jp japanese search engine
  • google.com international search engine
  • so.com chinese search engine
  • goo.ne.jp japanese search engine
  • istella.it italian search engine
  • jike.com / chinaso.com chinese search engine
  • lycos.com & hotbot.com international search engine
  • mail.ru russian search engine
  • google.com adsense bot
  • mojeek.com search engine
  • bing.com international search engine
  • orange.com international search engine
  • pinterest.com social networtk
  • botje.nl dutch search engine
  • qwant.com french search engine
  • rambler.ru russian search engine
  • seznam.cz czech search engine
  • soso.com chinese search engine
  • yahoo.com international search engine
  • sogou.com chinese search engine
  • sputnik.ru russian search engine
  • ask.com international search engine
  • twitter.com bot
  • wotbox.com international search engine
  • yacy.net p2p search software
  • yandex.com russian search engine
  • search.naver.com south korean search engine
  • yioop.com international search engine
  • yooz.ir iranian search engine
  • youdao.com chinese search engine
  • crawling rule(s) for above bots
  • disallow all other bots

Warnings

  • 3 invalid lines.