gemo.fr
robots.txt

Robots Exclusion Standard data for gemo.fr

Resource Scan

Scan Details

Site Domain gemo.fr
Base Domain gemo.fr
Scan Status Ok
Last Scan2024-04-22T11:58:05+00:00
Next Scan 2024-05-22T11:58:05+00:00

Last Scan

Scanned2024-04-22T11:58:05+00:00
URL https://gemo.fr/robots.txt
Redirect https://www.gemo.fr/robots.txt
Redirect Domain www.gemo.fr
Redirect Base gemo.fr
Domain IPs 34.117.137.200
Redirect IPs 204.246.191.124, 204.246.191.44, 204.246.191.45, 204.246.191.6
Response IP 18.165.171.86
Found Yes
Hash abbcfbde2fe96a4363ba5a85e10e625b1a20cd5f93d5981b7474868685e48442
SimHash 844679e20fc2

Groups

*

Rule Path
Disallow /admin.php/
Disallow /rest.php/
Disallow /rest.V1.php/
Disallow /ua.php/
Disallow /uaRest.php/
Disallow /ajax.php/
Disallow /ajax.V1.php/
Disallow /widget.php/
Disallow /widgetAPI.php/
Disallow /_service.php/
Disallow /storage.php/
Disallow /index.php/
Disallow /preview.php/
Disallow /ajaxPreview.php/

*

Rule Path
Disallow /resultat-de-recherche-produits?searchText=*
Disallow /*facetFilters*
Disallow /*/wp-login.php
Disallow /*/wp-admin/
Disallow /*/wp-includes/
Disallow /*/wp-content/
Disallow /*/filtre$
Disallow /*/wp-login.php
Disallow /*/wp-admin/
Disallow /*/wp-includes/
Disallow /*/wp-content/
Disallow /?s=%2F*
Disallow /*facetsFilter%3D*
Disallow /*%26fttchildReferences*
Disallow /*%26ps*
Disallow /*?ps*
Disallow /*?&filtre*
Disallow /*?sort*
Disallow /*%26sort%3D*
Disallow /*no-name-product/
Disallow /*no-name/
Disallow /*?rubrique=*
Disallow /*%26p%3D*
Disallow /*%26dir%3D*
Disallow /*%26limit%3D*
Disallow /*%26fttchildSkus*
Disallow /*fttmarque*
Disallow /*msclkid%3D*
Disallow /document/
Disallow /*ftttypes*
Disallow /*pn%3D*
Disallow /*p%3D*
Disallow /*fttcible*
Disallow /shop/*
Disallow /*?sytePage=results*

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

shopstylebot

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gemo.fr/Assets/Rbs/Seo/sitemap-index.xml

Comments

  • Ajouts Pixalione :