historique-voiture.fr
robots.txt

Robots Exclusion Standard data for historique-voiture.fr

Resource Scan

Scan Details

Site Domain historique-voiture.fr
Base Domain historique-voiture.fr
Scan Status Ok
Last Scan2024-09-28T08:43:58+00:00
Next Scan 2024-10-05T08:43:58+00:00

Last Scan

Scanned2024-09-28T08:43:58+00:00
URL https://historique-voiture.fr/robots.txt
Redirect https://www.historique-voiture.fr/robots.txt
Redirect Domain www.historique-voiture.fr
Redirect Base historique-voiture.fr
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 13.54.180.169
Found Yes
Hash eb7a3bf5607a52db1741de4092961070ee5babf5b77790845f31b21f3079748f
SimHash cc5e4a144d43

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

swebot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

bender

Rule Path
Disallow /

discobot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

searchwebengine.net

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

findfiles.net

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

goodzer

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

lemurwebcrawler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

fast enterprise crawler 6

Rule Path
Disallow /

sensis.com.au web crawler

Rule Path
Disallow /

worio bot heritrix

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.historique-voiture.fr/sitemap.xml

Warnings

  • 2 invalid lines.