montello.pl
robots.txt

Robots Exclusion Standard data for montello.pl

Resource Scan

Scan Details

Site Domain montello.pl
Base Domain montello.pl
Scan Status Ok
Last Scan2025-07-12T18:47:56+00:00
Next Scan 2025-08-11T18:47:56+00:00

Last Scan

Scanned2025-07-12T18:47:56+00:00
URL https://montello.pl/robots.txt
Domain IPs 77.79.221.138, 77.79.221.170
Response IP 77.79.221.138
Found Yes
Hash b8587aa31fcb440d090f8f66ddd73deb9780048e64c8f1aaf35eca84465665d2
SimHash 671da4508dd7

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /application
Disallow /environment
Allow /environment/cache/images
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add
Disallow /*/p/mail/recommend
Disallow /*/p/q
Disallow /*/reg
Disallow /*/login
Disallow /*/basket
Disallow /*/searchquery
Disallow /pl/index/2
Disallow /pl/index/4
Disallow /pl/new/2
Disallow /pl/new/3

Warnings

  • 1 invalid line.
  • `https` is not a known field.
  • `request-rate` is not a known field.