usel.az
robots.txt

Robots Exclusion Standard data for usel.az

Resource Scan

Scan Details

Site Domain usel.az
Base Domain usel.az
Scan Status Ok
Last Scan2024-09-24T07:31:32+00:00
Next Scan 2024-10-08T07:31:32+00:00

Last Scan

Scanned2024-09-24T07:31:32+00:00
URL https://usel.az/robots.txt
Domain IPs 94.130.49.20
Response IP 94.130.49.20
Found Yes
Hash c162ee1685047136dc3b79314fe58a715f1897180bdfa3350fd71042973c4a54
SimHash 791592e5d8a7

Groups

googlebot

Rule Path
Disallow /*?
Disallow /*?*
Disallow /wolt
Disallow /resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-123
Disallow /en/resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-123
Disallow /resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-456
Disallow /en/resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-456
Disallow /size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-123
Disallow /en/size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-123
Disallow /size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-456
Disallow /en/size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-456
Disallow /ttt
Disallow /en/ttt
Disallow /tttt
Disallow /en/tttt
Disallow /3d-qelem-printer-en
Disallow /en/3d-qelem-printer-en
Disallow /3d-qelem-printer
Disallow /en/3d-qelem-printer
Disallow /pjataja-novost
Disallow /en/pjataja-novost
Disallow /ru-bakida-faydali-orijinal-avtomobil-aksessuarlar-almaq
Disallow /en/ru-bakida-faydali-orijinal-avtomobil-aksessuarlar-almaq
Disallow /tretja-novost-ru
Disallow /en/tretja-novost-ru
Disallow /vtoraja-novost-ru
Disallow /en/vtoraja-novost-ru
Disallow /entest
Disallow /en/entest
Disallow /first-new
Disallow /en/first-new
Disallow /bpchl1t3gydcazc5blqh
Disallow /*sertifikatlardan-istifadenin-qaydalari.html
Disallow /sertifikatlardan-istifadenin-qaydalari.html
Disallow /az/sertifikatlardan-istifadenin-qaydalari.html
Disallow /en/sertifikatlardan-istifadenin-qaydalari.html
Disallow /account
Disallow /ttt
Disallow /affiliate
Disallow /checkout
Disallow /password
Disallow /forgot-password
Disallow /shopping-cart
Disallow /mailing
Disallow /proverka-seo-url-testoviy-tovar.html
Disallow /*proverka-seo-url-testoviy-tovar.html
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*mfp
Disallow /*view%3Ddesktop
Disallow /*productID
Disallow /*mega_filter
Disallow /admin
Disallow /after
Disallow /az_report_discount_card.php
Disallow /az_wholesale_registration.php
Disallow /before
Disallow /besplatnaya-dostavka-az.php
Disallow /besplatnaya-dostavka-en.php
Disallow /besplatnaya-dostavka.php
Disallow /bg.gif
Disallow /bpchl1t3gydcazc5blqh
Disallow /config.php
Disallow /cour.ttf
Disallow /dc
Disallow /en_report_discount_card.php
Disallow /en_wholesale_registration.php
Disallow /favicon.png
Disallow /fb
Disallow /fonariki
Disallow /fonts
Disallow /form1.php
Disallow /form3.php
Disallow /form-az1.php
Disallow /form-az.php
Disallow /form-en1.php
Disallow /form-en.php
Disallow /form.php
Disallow /form-us2az.php
Disallow /google2e8d04009ad2e583.html
Disallow /google5e3b70899dfbc63f.html
Disallow /google99c47f13a0b02790.html
Disallow /googlec14a1cd59c29b52a.html
Disallow /hm
Disallow /js
Disallow /kak-proyti-az.php
Disallow /kak-proyti-en.php
Disallow /kak-proyti.php
Disallow /kniga-zhalob.php
Disallow /mailing
Disallow /mommy-bag
Disallow /php.ini
Disallow /readme.txt
Disallow /report1.php
Disallow /report_discount_card.php
Disallow /report.php
Disallow /report-us2az.php
Disallow /sec_pic.php
Disallow /secpic.php
Disallow /send_kniga-zhalob.php
Disallow /shoesunder
Disallow /socnetauth2
Disallow /system
Disallow /test.html
Disallow /test.php
Disallow /thanks1.php
Disallow /thanks-az1.php
Disallow /thanks-az.php
Disallow /thanks-en1.php
Disallow /thanks-en.php
Disallow /thanks_kniga-zhalob.php
Disallow /thanks.php
Disallow /thanks-us2az.php
Disallow /thanks_wmz.php
Disallow /ttt
Disallow /up_normal.png
Disallow /wholesale_order.php
Disallow /wholesale_registration.php
Disallow /wholesale_report.php
Disallow /wmz-popolnenie.php
Disallow /wmz-prodazha.php
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /admin
Disallow /catalog
Disallow /system
Disallow *?page=*
Disallow /*%26sort%3D
Disallow /*%26order%3D
Disallow /*%26limit%3D
Disallow /*%26filter_name%3D
Disallow /*%26filter_sub_category%3D
Disallow /*%26filter_description%3D
Disallow /*%26tracking%3D
Disallow /*compare-products
Disallow /*search
Disallow /*checkout
Disallow /*login
Disallow /*logout
Disallow /*vouchers
Disallow /*wishlist
Disallow /*my-account
Disallow /*order-history
Disallow /*return-add
Disallow /*forgot-password
Disallow /*downloads
Disallow /*returns
Disallow /*transactions
Disallow /*create-account
Disallow /*recurring
Disallow /*address-book
Disallow /*reward-points
Disallow /*affiliate-forgot-password
Disallow /*create-affiliate-account
Disallow /*affiliate-login
Disallow /*affiliates
Disallow /*simpleregister
Disallow /*simplecheckout
Disallow *utm%3D
Disallow /terms

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

yandex

Rule Path
Disallow /*?
Disallow /*?*
Disallow /wolt
Disallow /resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-123
Disallow /en/resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-123
Disallow /resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-456
Disallow /en/resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-456
Disallow /size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-123
Disallow /en/size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-123
Disallow /size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-456
Disallow /en/size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-456
Disallow /ttt
Disallow /en/ttt
Disallow /tttt
Disallow /en/tttt
Disallow /3d-qelem-printer-en
Disallow /en/3d-qelem-printer-en
Disallow /3d-qelem-printer
Disallow /en/3d-qelem-printer
Disallow /pjataja-novost
Disallow /en/pjataja-novost
Disallow /ru-bakida-faydali-orijinal-avtomobil-aksessuarlar-almaq
Disallow /en/ru-bakida-faydali-orijinal-avtomobil-aksessuarlar-almaq
Disallow /tretja-novost-ru
Disallow /en/tretja-novost-ru
Disallow /vtoraja-novost-ru
Disallow /en/vtoraja-novost-ru
Disallow /entest
Disallow /en/entest
Disallow /first-new
Disallow /en/first-new
Disallow /sertifikatlardan-istifadenin-qaydalari.html
Disallow /az/sertifikatlardan-istifadenin-qaydalari.html
Disallow /en/sertifikatlardan-istifadenin-qaydalari.html
Disallow /proverka-seo-url-testoviy-tovar.html
Disallow /*proverka-seo-url-testoviy-tovar.html
Disallow /bpchl1t3gydcazc5blqh
Disallow /ttt
Disallow /account
Disallow /affiliate
Disallow /checkout
Disallow /password
Disallow /shopping-cart
Disallow /index.php?route=account
Disallow /index.php?route=account%2Faccount
Disallow /index.php?route=checkout%2Fcart
Disallow /index.php?route=checkout%2Fshipping
Disallow /index.php?route=common%2Fhome
Disallow /index.php?route=*%2Fcaptcha
Disallow /index.php?route=information%2Finformation&information_id=
Disallow /index.php?route=account%2Flogin
Disallow /login
Disallow /*route%3Daccount/
Disallow /*route%3Daccount/login
Disallow /*route%3Dcheckout/
Disallow /*route%3Dcheckout/cart
Disallow /*route%3Daffiliate/
Disallow /*route%3Dproduct/search
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*view%3Ddesktop
Disallow /*productID

claudebot
ahrefs
ahrefsbot/6.1
aspiegelbot
baiduspider
blexbot
bytespider
claudebot
datanyze
kinza
liebaofast
mb2345browser
micromessenger
oppo\sa33
petalbot
semrushbot
serpstatbot
spaziodati
yandexbot
yandexbot/3.0
zh-cn
mauibot
webmeup-crawler.com
mj12bot.com
petalsearch.com
dataforseo.com
ahrefs.com
opensiteexplorer.org
seostar.co
serpstatbot.com
search.com.ua
ltx71.com
megaindex.com
ahrefs.com
screaming frog
amazonbot
semrush.com
site-analyzer.pro
seekport.com
criteo.com
babbar.tech
website-datenbank.de
velen.io
pr-cy.ru
rainbot
bytedance.com
geedo.com
my-tiny-bot
fidget-spinner-bot
thesis-research-bot
claudebot
imagesift.com
go-http-client
feedburner.com
timpi.io
leipzig.de
scooter
infoseek
slurp
architextspider
lycos
gulliver
fast
grabber
outfoxbot/0.5
complex_network_group
alexibot
aqua_products
backdoorbot
backdoorbot/1.0
bpimagewalker/2.0
black.hole
blackwidow
blowfish
blowfish/1.0
bookmark search tool
bot mailto:craftbot@yahoo.com
botalot
botrighthere
builtbottough
bullseye
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
copernic
copyrightcheck
crescent
crescent internet toolpak http ole control v.1.0
custo
disco
disco pump 3.0
disco pump 3.2
discofinder
dittospyder
dotbot
download demon
download demon/3.2.0.8
download demon/3.5.0.11
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
express webpictures
express webpictures (www.express-soft.com)
extractorpro
eyenetie
fairad client
flaming attackbot
flashget
flashget webwasher 3.2
foobot
frontpage
frontpage [nc,or]
gaisbot
getright
getright/2.11
getright/3.1
getright/3.2
getright/3.3
getright/3.3.3
getright/3.3.4
getright/4.0.0
getright/4.1.0
getright/4.1.1
getright/4.1.2
getright/4.2
getright/4.2b (portuguxeas)
getright/4.2c
getright/4.3
getright/4.5
getright/4.5a
getright/4.5b
getright/4.5b1
getright/4.5b2
getright/4.5b3
getright/4.5b6
getright/4.5b7
getright/4.5c
getright/4.5d
getright/4.5e
getright/5.0beta1
getright/5.0beta2
getweb!
go!zilla
go!zilla (www.gozilla.com)
go!zilla 3.3 (www.gozilla.com)
go!zilla 3.5 (www.gozilla.com)
go-ahead-got-it
grabnet
grafula
hmview
httrack
httrack 3.0
httrack 3.0x
httrack [nc,or]
harvest
harvest/1.5
image stripper
image sucker
indy library
indy library [nc,or]
infonavirobot
interget
internet ninja
internet ninja 4.0
internet ninja 5.0
internet ninja 6.0
iron33/1.0.2
joc web spider
jennybot
jetcar
kenjin spider
kenjin.spider
keyword density/0.9
keyword.density
lnspiderguy
leechftp
lexibot
linkscan/8.1a unix
linkscan/8.1a.unix
linkwalker
linkextractorpro
midown tool
miixpc
miixpc/4.2
mj12bot
msiecrawler
mass downloader
mass downloader/2.2
mata hari
mata.hari
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
microsoft.url
mister pix
mister pix version.dll
mister pix ii 2.01
mister pix ii 2.02a
mister.pix
nicerspro
npbot
npbot
navroad
nearsite
net vampire
net vampire/3.0
netants
netants/1.10
netants/1.23
netants/1.24
netants/1.25
netmechanic
netspider
netzip
netzip downloader 1.0 win32(nov 12 1998)
netzip-downloader/1.0.62 (win32; dec 7 1998)
netzippy+(http:/www.innerprise.net/usp-spider.asp)
octopus
offline explorer
offline explorer/1.2
offline explorer/1.4
offline explorer/1.6
offline explorer/1.7
offline explorer/1.9
offline explorer/2.0
offline explorer/2.1
offline explorer/2.3
offline explorer/2.4
offline explorer/2.5
offline navigator
offline.explorer
openbot
openfind
openfind data gatherer
openwebspider
oracle ultra search
pagegrabber
papa foto
perman
propowerbot/2.14
prowebwalker
proximic
python-urllib
queryn metasearch
queryn.metasearch
rma
radiation retriever 1.1
reget
realdownload
realdownload/4.0.0.40
realdownload/4.0.0.41
realdownload/4.0.0.42
repomonkey
repomonkey bait & tackle/v1.01
sitesnagger
slysearch
smartdownload
smartdownload/1.2.76 (win32; apr 1 1999)
smartdownload/1.2.77 (win32; aug 17 1999)
smartdownload/1.2.77 (win32; feb 1 2000)
smartdownload/1.2.77 (win32; jun 19 2001)
spankbot
sqworm/2.9.85-beta (beta_release; 20011115-775; i686-pc-linux
superbot
superbot/3.0 (win32)
superbot/3.1 (win32)
superhttp
superhttp/1.0
surfbot
szukacz/1.4
teleport
teleport pro
teleport pro/1.29
teleport pro/1.29.1590
teleport pro/1.29.1634
teleport pro/1.29.1718
teleport pro/1.29.1820
teleport pro/1.29.1847
teleportpro
telesoft
the intraformant
the.intraformant
thenomad
tighttwatbot
titan
true_robot
true_robot/1.0
turnitinbot
turnitinbot/1.5
url control
url_spider_pro
urly warning
urly.warning
vci
vci webviewer vci webviewer win32
voideye
www-collector-e
wwwoffle
web image collector
web sucker
web.image.collector
webauto
webauto/3.40 (win98; i)
webbandit
webbandit/3.50
webcapture 2.0
webcopier
webcopier v.2.2
webcopier v2.5
webcopier v2.6
webcopier v2.7a
webcopier v2.8
webcopier v3.0
webcopier v3.0.1
webcopier v3.2
webcopier v3.2a
webemailextrac.*
webenhancer
webfetch
webgo is
webleacher
webreaper
webreaper [info@webreaper.net]
webreaper [webreaper@otway.com]
webreaper v9.1 - www.otway.com/webreaper
webreaper v9.7 - www.webreaper.net
webreaper v9.8 - www.webreaper.net
webreaper vwebreaper v7.3 - www,otway.com/webreaper
websauger
websauger 1.20b
websauger 1.20j
websauger 1.20k
webstripper
webstripper/2.03
webstripper/2.10
webstripper/2.12
webstripper/2.13
webstripper/2.15
webstripper/2.16
webstripper/2.19
webwhacker
webzip
webzip/2.75 (http:/www.spidersoft.com)
webzip/3.65 (http:/www.spidersoft.com)
webzip/3.80 (http:/www.spidersoft.com)
webzip/4.0 (http:/www.spidersoft.com)
webzip/4.1 (http:/www.spidersoft.com)
webzip/4.21
webzip/4.21 (http:/www.spidersoft.com)
webzip/5.0
webzip/5.0 (http:/www.spidersoft.com)
webzip/5.0 pr1 (http:/www.spidersoft.com)
webzip
webzip/4.0
webmasterworldforumbot
website quester
website quester - www.asona.org
website quester - www.esalesbiz.com/extra/
website extractor
website extractor (http:/www.asona.org)
website.quester
webster pro
webster.pro
wget
wget/1.10.2
wget/1.5.2
wget/1.5.3
wget/1.6
wget/1.7
wget/1.8
wget/1.8.1
wget/1.8.1+cvs
wget/1.8.2
wget/1.9-beta
widow
xaldon webspider
xaldon webspider 2.5.b3
xenu's
xenu's link sleuth 1.1c
zeus
zeus 11389 webster pro v2.9 win32
zeus 11652 webster pro v2.9 win32
zeus 18018 webster pro v2.9 win32
zeus 26378 webster pro v2.9 win32
zeus 30747 webster pro v2.9 win32
zeus 32297 webster pro v2.9 win32
zeus 39206 webster pro v2.9 win32
zeus 41641 webster pro v2.9 win32
zeus 44238 webster pro v2.9 win32
zeus 51070 webster pro v2.9 win32
zeus 51674 webster pro v2.9 win32
zeus 51837 webster pro v2.9 win32
zeus 63567 webster pro v2.9 win32
zeus 6694 webster pro v2.9 win32
zeus 71129 webster pro v2.9 win32
zeus 82016 webster pro v2.9 win32
zeus 82900 webster pro v2.9 win32
zeus 84842 webster pro v2.9 win32
zeus 90872 webster pro v2.9 win32
zeus 94934 webster pro v2.9 win32
zeus 95245 webster pro v2.9 win32
zeus 95351 webster pro v2.9 win32
zeus 97371 webster pro v2.9 win32
zeus link scout
asterias
b2w/0.1
cosmos
ecatch
ecatch/3.0
hloader
httplib
humanlinks
larbin
larbin (samualt9@bigfoot.com)
larbin samualt9@bigfoot.com
larbin_2.6.2 (kabura@sushi.com)
larbin_2.6.2 (larbin2.6.2@unspecified.mail)
larbin_2.6.2 (listonatccdotgatechdotedu)
larbin_2.6.2 (vitalbox1@hotmail.com)
larbin_2.6.2 kabura@sushi.com
larbin_2.6.2 larbin2.6.2@unspecified.mail
larbin_2.6.2 larbin@correa.org
larbin_2.6.2 listonatccdotgatechdotedu
larbin_2.6.2 vitalbox1@hotmail.com
libweb/clshttp
lwp-trivial
lwp-trivial/1.34
moget
moget/2.1
pavuk
pcbrowser
psbot
searchpreview
spanner
suzuran
takeout
tocrawl/urldispatcher
turingos
webfetch/2.1.0
wget

Rule Path
Disallow /

*

Rule Path
Disallow /*?
Disallow /*?*
Disallow /wolt
Disallow /resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-123
Disallow /en/resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-123
Disallow /resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-456
Disallow /en/resm-cekmek-ucun-qrafik-planset-nece-secmek-lazimdir-456
Disallow /size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-123
Disallow /en/size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-123
Disallow /size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-456
Disallow /en/size-xatirlatmaq-isteyirik-ki-bizden-butun-alinan-mallarina-gun-erzinde-catdirilma-movcuddur-456
Disallow /ttt
Disallow /en/ttt
Disallow /tttt
Disallow /en/tttt
Disallow /3d-qelem-printer-en
Disallow /en/3d-qelem-printer-en
Disallow /3d-qelem-printer
Disallow /en/3d-qelem-printer
Disallow /pjataja-novost
Disallow /en/pjataja-novost
Disallow /ru-bakida-faydali-orijinal-avtomobil-aksessuarlar-almaq
Disallow /en/ru-bakida-faydali-orijinal-avtomobil-aksessuarlar-almaq
Disallow /tretja-novost-ru
Disallow /en/tretja-novost-ru
Disallow /vtoraja-novost-ru
Disallow /en/vtoraja-novost-ru
Disallow /entest
Disallow /en/entest
Disallow /first-new
Disallow /en/first-new
Disallow /sertifikatlardan-istifadenin-qaydalari.html
Disallow /az/sertifikatlardan-istifadenin-qaydalari.html
Disallow /en/sertifikatlardan-istifadenin-qaydalari.html
Disallow /proverka-seo-url-testoviy-tovar.html
Disallow /*proverka-seo-url-testoviy-tovar.html
Disallow /*mfp
Disallow /*mega_filter
Disallow /*?mfp
Disallow /bpchl1t3gydcazc5blqh
Disallow /ttt
Disallow /*view%3Ddesktop
Disallow /*productID
Disallow /account
Disallow /affiliate
Disallow /checkout
Disallow /password
Disallow /shopping-cart
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*?page=$
Disallow /*%26page%3D$
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*mfp
Disallow /*mega_filter
Disallow /*?mfp
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /admin
Disallow /catalog
Disallow /system
Disallow *?page=*
Disallow /*%26sort%3D
Disallow /*%26order%3D
Disallow /*%26limit%3D
Disallow /*%26filter_name%3D
Disallow /*%26filter_sub_category%3D
Disallow /*%26filter_description%3D
Disallow /*%26tracking%3D
Disallow /*compare-products
Disallow /*search
Disallow /*checkout
Disallow /*login
Disallow /*logout
Disallow /*vouchers
Disallow /*wishlist
Disallow /*my-account
Disallow /*order-history
Disallow /*return-add
Disallow /*forgot-password
Disallow /*downloads
Disallow /*returns
Disallow /*transactions
Disallow /*create-account
Disallow /*recurring
Disallow /*address-book
Disallow /*reward-points
Disallow /*affiliate-forgot-password
Disallow /*create-affiliate-account
Disallow /*affiliate-login
Disallow /*affiliates
Disallow /*simpleregister
Disallow /*simplecheckout
Disallow *utm%3D
Disallow /terms

Other Records

Field Value
sitemap https://usel.az/sitemap.xml
sitemap https://usel.az/imgsitemap.xml
sitemap https://usel.az/sitemap.xml
sitemap https://usel.az/imgsitemap.xml
sitemap https://usel.az/sitemap.xml
sitemap https://usel.az/imgsitemap.xml

Comments

  • Sitemap: https://usel.az/index.php?route=extension/feed/sitemap_image
  • Sitemap: https://usel.az/index.php?route=extension/feed/simple_google_sitemap_pro
  • Disallow: /sitemap.xml
  • Disallow: /robots.txt
  • Sitemap: https://usel.az/index.php?route=extension/feed/simple_google_sitemap_pro
  • Disallow: /*mfp
  • Disallow: /*mega_filter
  • Disallow: /index.php?route=product*
  • Disallow: /index.php?route=product/product*&manufacturer_id=
  • Disallow: /index.php?route=product/search
  • Sitemap: https://usel.az/index.php?route=extension/feed/sitemap_image
  • Sitemap: https://usel.az/index.php?route=extension/feed/simple_google_sitemap_pro

Warnings

  • 1 invalid line.