selectiona.free.fr
robots.txt

Robots Exclusion Standard data for selectiona.free.fr

Resource Scan

Scan Details

Site Domain selectiona.free.fr
Base Domain free.fr
Scan Status Ok
Last Scan2025-12-16T08:09:09+00:00
Next Scan 2026-01-15T08:09:09+00:00

Last Scan

Scanned2025-12-16T08:09:09+00:00
URL http://selectiona.free.fr/robots.txt
Redirect https://selectiona.pages-perso.free.fr/robots.txt
Redirect Domain selectiona.pages-perso.free.fr
Redirect Base free.fr
Domain IPs 212.27.63.119, 2a01:e0c:1:1597::119
Redirect IPs 212.27.63.176, 2a01:e0c:1:1597::176
Response IP 212.27.63.176
Found Yes
Hash a69cf48f3b034de5f5a749fa81ccf79de326b669945542ece11909113a3c27d1
SimHash 324c5680cc09

Groups

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

cocolyzebot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

wget

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

sogou web spider
sogou spider
sogou inst spider

Rule Path
Disallow /

*

Rule Path
Disallow /images/