pierrerobert.eu
robots.txt

Robots Exclusion Standard data for pierrerobert.eu

Resource Scan

Scan Details

Site Domain pierrerobert.eu
Base Domain pierrerobert.eu
Scan Status Ok
Last Scan2026-03-18T05:03:13+00:00
Next Scan 2026-03-25T05:03:13+00:00

Last Scan

Scanned2026-03-18T05:03:13+00:00
URL https://pierrerobert.eu/robots.txt
Domain IPs 104.21.55.6, 172.67.170.6, 2606:4700:3030::ac43:aa06, 2606:4700:3034::6815:3706
Response IP 104.21.55.6
Found Yes
Hash bf605cacc01ce3e1d46b1f37ef352ff07a0ffb047afaf1d33e3600f9ccf9ee35
SimHash 401e9160ee00

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

aliyunsecbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.