zdronet.pl
robots.txt

Robots Exclusion Standard data for zdronet.pl

Resource Scan

Scan Details

Site Domain zdronet.pl
Base Domain zdronet.pl
Scan Status Ok
Last Scan2024-11-15T08:41:49+00:00
Next Scan 2024-11-22T08:41:49+00:00

Last Scan

Scanned2024-11-15T08:41:49+00:00
URL https://zdronet.pl/robots.txt
Redirect https://www.zdronet.pl/robots.txt
Redirect Domain www.zdronet.pl
Redirect Base zdronet.pl
Domain IPs 79.137.71.21
Redirect IPs 79.137.71.21
Response IP 79.137.71.21
Found Yes
Hash 1faaa9098ae47044e436d461fc4029cd836b51777b832fde4291c92fca9c336f
SimHash 2a48d5b04104

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mediapartners-google

Rule Path
Disallow
Allow /

googlebot

Rule Path
Allow /
Disallow /chart/
Disallow /cms/
Disallow /dcache/
Disallow /ranking/
Disallow /scripts/
Disallow /soap/
Disallow /styles/
Disallow /xml/

slurp

Rule Path
Allow /
Disallow /chart/
Disallow /cms/
Disallow /dcache/
Disallow /ranking/
Disallow /scripts/
Disallow /soap/
Disallow /styles/
Disallow /xml/

msnbot

Rule Path
Allow /
Disallow /chart/
Disallow /cms/
Disallow /dcache/
Disallow /ranking/
Disallow /scripts/
Disallow /soap/
Disallow /styles/
Disallow /xml/