mrugala.pl
robots.txt

Robots Exclusion Standard data for mrugala.pl

Resource Scan

Scan Details

Site Domain mrugala.pl
Base Domain mrugala.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-29T10:00:39+00:00
Next Scan 2026-03-30T10:00:39+00:00

Last Successful Scan

Scanned2025-11-06T21:01:26+00:00
URL https://mrugala.pl/robots.txt
Domain IPs 77.79.221.130, 77.79.221.162
Response IP 77.79.221.130
Found Yes
Hash 343a68c378cf67e505108c57df12c183fd5c56b31488a9d79a10714dab6dad9e
SimHash e13d3d50cdd7

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /*/p/mail/recommend
Disallow /*/p/q
Allow /environment/cache/images
Disallow /application
Disallow /environment
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add
Disallow /*/reg
Disallow /*/login
Disallow /*/basket
Disallow /*/searchquery

Warnings

  • `request-rate` is not a known field.