1pv.fr
robots.txt

Robots Exclusion Standard data for 1pv.fr

Resource Scan

Scan Details

Site Domain 1pv.fr
Base Domain 1pv.fr
Scan Status Ok
Last Scan2024-06-09T20:10:49+00:00
Next Scan 2024-06-16T20:10:49+00:00

Last Scan

Scanned2024-06-09T20:10:49+00:00
URL https://www.1pv.fr/robots.txt
Domain IPs 169.150.247.39, 2400:52e0:1e00::1080:1
Response IP 169.150.247.37
Found Yes
Hash 36e141c899c5a2dcb34cf10dddc37ca246073a5c94c9079b5936dc36887d1313
SimHash ca5dca02ea12

Groups

*

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

linguee

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /