adameteve.fr
robots.txt

Robots Exclusion Standard data for adameteve.fr

Resource Scan

Scan Details

Site Domain adameteve.fr
Base Domain adameteve.fr
Scan Status Ok
Last Scan2024-10-19T17:37:28+00:00
Next Scan 2024-11-18T17:37:28+00:00

Last Scan

Scanned2024-10-19T17:37:28+00:00
URL https://adameteve.fr/robots.txt
Redirect https://www.adameteve.fr/robots.txt
Redirect Domain www.adameteve.fr
Redirect Base adameteve.fr
Domain IPs 2600:1901:0:b5fd::80, 34.120.122.31
Redirect IPs 2600:1901:0:b5fd::80, 34.120.122.31
Response IP 34.120.122.31
Found Yes
Hash 0e5f827986717c515ecfcb74a01fac1d04deb01a93ee8fd9900f3d25537fc78f
SimHash 6b419075e173

Groups

*

Rule Path
Disallow /ajax
Disallow /pdf
Disallow /panier-de-caisse/
Disallow /panier-de-caisse.html
Disallow /adresse-de-caisse/
Disallow /adresse-de-caisse.html
Disallow /apercu-de-la-caisse/
Disallow /apercu-de-la-caisse.html
Disallow /livraison-a-la-caisse/
Disallow /connexion-a-la-caisse/
Disallow /mode-de-paiement-de-la-caisse/
Disallow /ordre/
Disallow /ordre.html
Disallow /annuler-la-commande/
Disallow /annuler-la-commande.html
Disallow /order-error/
Disallow /order-error.html
Disallow /caisse-enregistreuse/
Disallow /caisse-enregistreuse.html
Disallow /voir-la-commande.html
Disallow /formulaire-de-retour.html
Disallow /merci.html
Disallow /recherche.html
Disallow /revue.html
Disallow /compte/
Disallow /enregistrement-de-compte/
Disallow /facture/
Disallow /vous-avez-oublie-votre-mot-de-passe/
Disallow /recherche*
Disallow /catalogsearch*
Disallow /ero/
Disallow /ero/
Disallow /service-client/conditions.html

ahrefsbot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

twengabot-2.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.adameteve.fr/sitemap_index.xml