Log In Sign Up

alwosta.tn
robots.txt

Robots Exclusion Standard data for alwosta.tn

Resource Scan

Scan Details

Site Domain alwosta.tn
Base Domain alwosta.tn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-10-21T08:20:58+00:00
Next Scan 2025-01-19T08:20:58+00:00

Last Successful Scan

Scanned2024-03-26T08:14:43+00:00
URL https://alwosta.tn/robots.txt
Domain IPs 104.21.5.109, 172.67.133.87, 2606:4700:3032::ac43:8557, 2606:4700:3037::6815:56d
Response IP 104.21.5.109
Found Yes
Hash 178c153c3a974cbc0e6f81aa7f4edde0e2ce844179429d1919e69cc92e02f77c
SimHash 52127b40859f

Groups

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Allow */modules/*.gif
Allow */modules/*.svg
Allow */modules/*.webp
Allow /js/jquery/*
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dregistration
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /fr/app/
Disallow /fr/cache/
Disallow /fr/classes/
Disallow /fr/config/
Disallow /fr/controllers/
Disallow /fr/download/
Disallow /fr/js/
Disallow /fr/localization/
Disallow /fr/log/
Disallow /fr/mails/
Disallow /fr/modules/
Disallow /fr/override/
Disallow /fr/pdf/
Disallow /fr/src/
Disallow /fr/tools/
Disallow /fr/translations/
Disallow /fr/upload/
Disallow /fr/var/
Disallow /fr/vendor/
Disallow /fr/webservice/
Disallow /ar/app/
Disallow /ar/cache/
Disallow /ar/classes/
Disallow /ar/config/
Disallow /ar/controllers/
Disallow /ar/download/
Disallow /ar/js/
Disallow /ar/localization/
Disallow /ar/log/
Disallow /ar/mails/
Disallow /ar/modules/
Disallow /ar/override/
Disallow /ar/pdf/
Disallow /ar/src/
Disallow /ar/tools/
Disallow /ar/translations/
Disallow /ar/upload/
Disallow /ar/var/
Disallow /ar/vendor/
Disallow /ar/webservice/
Disallow /en/app/
Disallow /en/cache/
Disallow /en/classes/
Disallow /en/config/
Disallow /en/controllers/
Disallow /en/download/
Disallow /en/js/
Disallow /en/localization/
Disallow /en/log/
Disallow /en/mails/
Disallow /en/modules/
Disallow /en/override/
Disallow /en/pdf/
Disallow /en/src/
Disallow /en/tools/
Disallow /en/translations/
Disallow /en/upload/
Disallow /en/var/
Disallow /en/vendor/
Disallow /en/webservice/
Disallow /*fr/adresse
Disallow /*fr/adresses
Disallow /*fr/connexion
Disallow /*fr/panier
Disallow /*fr/reduction
Disallow /*fr/suivi-commande-invite
Disallow /*fr/historique-commandes
Disallow /*fr/identite
Disallow /*fr/mon-compte
Disallow /*fr/commande
Disallow /*fr/confirmation-commande
Disallow /*fr/suivi-commande
Disallow /*fr/avoirs
Disallow /*fr/recuperation-mot-de-passe
Disallow /*fr/recherche
Disallow /*ar/%C3%98%C2%AE%C3%98%C2%B5%C3%99
Disallow /*en/address
Disallow /*en/addresses
Disallow /*en/authentication
Disallow /*en/cart
Disallow /*en/discount
Disallow /*en/guest-tracking
Disallow /*en/order-history
Disallow /*en/identity
Disallow /*en/my-account
Disallow /*en/order
Disallow /*en/order-confirmation
Disallow /*en/order-follow
Disallow /*en/credit-slip
Disallow /*en/password-recovery
Disallow /*en/search

alphaseobot
alphaseobot-sa
blexbot
alexibot
alvinetspider
antenne hatena
apocalxexplorerbot
asterias
backdoorbot/1.0
bizinformation
black hole
blowfish/1.0
botalot
builtbottough
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
disco pump 3.1
dittospyder
dotbot
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
flamingo_searchengine
foobot
grapeshot
harvest/1.5
hloader
httplib
httrack
httrack 3.0
humanlinks
igentia
infonavirobot
jennybot
jikespider
kenjin spider
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lwp-trivial
lwp-trivial/1.34
mata hari
miixpc
miixpc/4.2
mister pix
mlbot
moget
moget/2.1
ms search 4.0 robot
ms search 5.0 robot
naverbot
netants
netattache
netmechanic
nicerspro
offline explorer
openfind
openindexspider
propowerbot/2.14
prowebwalker
psbot
quepasacreep
queryn metasearch
repomonkey
rma
sightupbot
sitebot
sitesnagger
sitesucker
sogou web spider
sosospider
spankbot
spanner
speedy
suggybot
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
toscrawler
trendictionbot
true_robot
true_robot/1.0
turingos
turnitinbot
urlpouls
urly warning
vci
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
wget
wikiofeedbot
winhttrack
www-collector-e
xenu link sleuth/1.3.8
yacy
yrspider
zeus
zookabot
twengabot
jetbot
converacrawler

Rule Path
Disallow /
Disallow /en/blog/search
Disallow /fr/blog/search
Disallow /ar/blog/search
Disallow /modules/stblogcomments/views/img/avatar/small.jpg
Back to top

Other Records

Field Value
sitemap https://www.alwosta.tn/1_index_sitemap.xml
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • https://www.prestashop.com - https://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/robotstxt.html
  • Allow Directives
  • Private pages
  • Directories for www.alwosta.tn
  • Files
  • Blocage bots zou
  • Ajoute par zou
  • Sitemap
Back to top

Warnings

  • 16 invalid lines.
Back to top