123comparer.fr
robots.txt

Robots Exclusion Standard data for 123comparer.fr

Resource Scan

Scan Details

Site Domain 123comparer.fr
Base Domain 123comparer.fr
Scan Status Ok
Last Scan2024-09-21T05:53:26+00:00
Next Scan 2024-10-21T05:53:26+00:00

Last Scan

Scanned2024-09-21T05:53:26+00:00
URL https://123comparer.fr/robots.txt
Redirect https://www.123comparer.fr/robots.txt
Redirect Domain www.123comparer.fr
Redirect Base 123comparer.fr
Domain IPs 212.129.1.218
Redirect IPs 212.129.1.218
Response IP 212.129.1.218
Found Yes
Hash 97413a530570abd937fa0a0a84bcdc843d7e98bfb4ff4da6035d8a789359b5cf
SimHash 5a5df950aa00

Groups

*

Rule Path
Disallow /voir_produit.php
Disallow /hcaptcha/*
Disallow /tchatSend.php
Disallow /autocomp.php
Disallow /appli123.php
Disallow /application.php

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

yandex

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /