muzeumpiosenki.pl
robots.txt

Robots Exclusion Standard data for muzeumpiosenki.pl

Resource Scan

Scan Details

Site Domain muzeumpiosenki.pl
Base Domain muzeumpiosenki.pl
Scan Status Ok
Last Scan2024-10-05T05:45:42+00:00
Next Scan 2024-11-04T05:45:42+00:00

Last Scan

Scanned2024-10-05T05:45:42+00:00
URL https://muzeumpiosenki.pl/robots.txt
Domain IPs 78.11.111.114
Response IP 78.11.111.114
Found Yes
Hash 25d85fc297726053e131980835de5f6dec5333f659db97beb489126690e2ec80
SimHash 1a5dfdd0f991

Groups

ahrefsbot

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

http://webmeup.com/crawler.html

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandex/1.01.001

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

Warnings

  • 2 invalid lines.