hessautomobile.com
robots.txt
Robots Exclusion Standard data for hessautomobile.com
Resource Scan
Scan Details
| Site Domain | hessautomobile.com |
| Base Domain | hessautomobile.com |
| Scan Status | Ok |
| Last Scan | 2025-10-17T14:19:31+00:00 |
| Next Scan | 2025-11-16T14:19:31+00:00 |
Last Scan
| Scanned | 2025-10-17T14:19:31+00:00 |
| URL | https://hessautomobile.com/robots.txt |
| Redirect | https://www.hessautomobile.com/robots/www.hessautomobile.com.txt |
| Redirect Domain | www.hessautomobile.com |
| Redirect Base | hessautomobile.com |
| Domain IPs | 91.132.254.200 |
| Redirect IPs | 91.132.254.200 |
| Response IP | 91.132.254.200 |
| Found | Yes |
| Hash | b42736886e87dff58f9719863ceed716ffd4dc19a24abf484b2c6344eb409983 |
| SimHash | 32621941061c |
Groups
*
| Rule | Path |
|---|---|
| Allow | */modules/*.css |
| Allow | */modules/*.js |
| Allow | */modules/*.png |
| Allow | */modules/*.jpg |
| Allow | /js/jquery/* |
| Disallow | /*?order= |
| Disallow | /*?tag= |
| Disallow | /*?id_currency= |
| Disallow | /*?search_query= |
| Disallow | /*?back= |
| Disallow | /*?n= |
| Disallow | /*%26order%3D |
| Disallow | /*%26tag%3D |
| Disallow | /*%26id_currency%3D |
| Disallow | /*%26search_query%3D |
| Disallow | /*%26back%3D |
| Disallow | /*%26n%3D |
| Disallow | /*controller%3Daddresses |
| Disallow | /*controller%3Daddress |
| Disallow | /*controller%3Dauthentication |
| Disallow | /*controller%3Dcart |
| Disallow | /*controller%3Ddiscount |
| Disallow | /*controller%3Dfooter |
| Disallow | /*controller%3Dget-file |
| Disallow | /*controller%3Dheader |
| Disallow | /*controller%3Dhistory |
| Disallow | /*controller%3Didentity |
| Disallow | /*controller%3Dimages.inc |
| Disallow | /*controller%3Dinit |
| Disallow | /*controller%3Dmy-account |
| Disallow | /*controller%3Dorder |
| Disallow | /*controller%3Dorder-slip |
| Disallow | /*controller%3Dorder-detail |
| Disallow | /*controller%3Dorder-follow |
| Disallow | /*controller%3Dorder-return |
| Disallow | /*controller%3Dorder-confirmation |
| Disallow | /*controller%3Dpagination |
| Disallow | /*controller%3Dpassword |
| Disallow | /*controller%3Dpdf-invoice |
| Disallow | /*controller%3Dpdf-order-return |
| Disallow | /*controller%3Dpdf-order-slip |
| Disallow | /*controller%3Dproduct-sort |
| Disallow | /*controller%3Dsearch |
| Disallow | /*controller%3Dstatistics |
| Disallow | /*controller%3Dattachment |
| Disallow | /*controller%3Dguest-tracking |
| Disallow | /app/ |
| Disallow | /cache/ |
| Disallow | /classes/ |
| Disallow | /config/ |
| Disallow | /controllers/ |
| Disallow | /download/ |
| Disallow | /js/ |
| Disallow | /localization/ |
| Disallow | /log/ |
| Disallow | /mails/ |
| Disallow | /modules/ |
| Disallow | /override/ |
| Disallow | /pdf/ |
| Disallow | /src/ |
| Disallow | /tools/ |
| Disallow | /translations/ |
| Disallow | /upload/ |
| Disallow | /var/ |
| Disallow | /vendor/ |
| Disallow | /webservice/ |
| Disallow | /fr/app/ |
| Disallow | /fr/cache/ |
| Disallow | /fr/classes/ |
| Disallow | /fr/config/ |
| Disallow | /fr/controllers/ |
| Disallow | /fr/download/ |
| Disallow | /fr/js/ |
| Disallow | /fr/localization/ |
| Disallow | /fr/log/ |
| Disallow | /fr/mails/ |
| Disallow | /fr/modules/ |
| Disallow | /fr/override/ |
| Disallow | /fr/pdf/ |
| Disallow | /fr/src/ |
| Disallow | /fr/tools/ |
| Disallow | /fr/translations/ |
| Disallow | /fr/upload/ |
| Disallow | /fr/var/ |
| Disallow | /fr/vendor/ |
| Disallow | /fr/webservice/ |
| Disallow | /*fr/adresse |
| Disallow | /adresse |
| Disallow | /*fr/adresses |
| Disallow | /adresses |
| Disallow | /*fr/connexion |
| Disallow | /connexion |
| Disallow | /*fr/panier |
| Disallow | /panier |
| Disallow | /*fr/reduction |
| Disallow | /reduction |
| Disallow | /*fr/suivi-commande-invite |
| Disallow | /suivi-commande-invite |
| Disallow | /*fr/historique-commandes |
| Disallow | /historique-commandes |
| Disallow | /*fr/identite |
| Disallow | /identite |
| Disallow | /*fr/mon-compte |
| Disallow | /mon-compte |
| Disallow | /*fr/commande |
| Disallow | /commande |
| Disallow | /*fr/confirmation-commande |
| Disallow | /confirmation-commande |
| Disallow | /*fr/suivi-commande |
| Disallow | /suivi-commande |
| Disallow | /*fr/avoirs |
| Disallow | /avoirs |
| Disallow | /*fr/recuperation-mot-de-passe |
| Disallow | /recuperation-mot-de-passe |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
oncrawl
seznambot
viglink
dotbot
custo
sputnikbot
sputnik
sputnikbot/2.3
curious george
http://site.ru
site.ru
mauibot
seokicks
blexbot
bubing
scoutjet
grapeshot
grapeshotcrawler
seekport crawler
zoominfobot
barkrowler
datanyze
yisouspider
adscanner
genieo
genieo/1.0
the knowledge ai
zgrab
zoominfobot
sogou spider
blekkobot
seobility
baiduspider
baiduspider/2.0
yandexbot
istellabot
istellabot/1.01.18
istellabot/1.10.2
cliqzbot
sogou web spider/4.0
grouphigh
grouphigh/1.0
mail.ru
grapeshotcrawler
ia_archiver
james bot
leikibot
libcurl
linkdexbot
lipperhey
livelap
lssrocket
magpie
gluten free crawler/1.0
serpstatbot/1.0
domaincrawler
steeler
steeler/3.5
daum
awariosmartbot
mojeekbot
mojeek
python-request
netcraft
yeti-mobile
sjuupbot
viglink
pi-monster
tracemyfile/1.0
xenu's link sleuth 1.1c
cowbot/1.0
deskyobot
deskyobot/1.0
pandalytics/1.0
surdotlybot
cincraw/1.0
twingly recon-klondike/1.0
yak/1.0
df bot 1.0
crawlson/1.0
ioncrawl
ltx71
petalbot
aspiegelbot
filibot/1.0
panscient.com
mediatoolkitbot
obot/2.3.1
fasterfox
boitho.com-dc
cazoodlebot
converacrawler
discobot
gaisbot
heritrix
ichiro
irlbot
kalooga
mj12bot
mlbot
msiecrawler
nutch
ocelli
penthesilea
phpdig
searchdaimon.com-dc
shopwiki
snapbot
turnitinbot
twiceler
woozweb-monitoring
woriobot
yandex
yeti
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hessautomobile.com/1_index_sitemap.xml |
Comments