paroles-musique.com
robots.txt

Robots Exclusion Standard data for paroles-musique.com

Resource Scan

Scan Details

Site Domain paroles-musique.com
Base Domain paroles-musique.com
Scan Status Ok
Last Scan2024-06-10T06:09:47+00:00
Next Scan 2024-06-17T06:09:47+00:00

Last Scan

Scanned2024-06-10T06:09:47+00:00
URL https://paroles-musique.com/robots.txt
Redirect https://www.paroles-musique.com/robots.txt
Redirect Domain www.paroles-musique.com
Redirect Base paroles-musique.com
Domain IPs 104.26.12.134, 104.26.13.134, 172.67.70.47, 2606:4700:20::681a:c86, 2606:4700:20::681a:d86, 2606:4700:20::ac43:462f
Redirect IPs 104.26.12.134, 104.26.13.134, 172.67.70.47, 2606:4700:20::681a:c86, 2606:4700:20::681a:d86, 2606:4700:20::ac43:462f
Response IP 104.26.13.134
Found Yes
Hash 2abf6e1df384635d0a6a2303c2797797a99e74033331f1b0de5fb4c3a5961034
SimHash 6210d5c2db59

Groups

*

Rule Path
Disallow /inc/

yandex

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /