multanex.pl
robots.txt

Robots Exclusion Standard data for multanex.pl

Resource Scan

Scan Details

Site Domain multanex.pl
Base Domain multanex.pl
Scan Status Ok
Last Scan2025-07-11T03:30:54+00:00
Next Scan 2025-08-10T03:30:54+00:00

Last Scan

Scanned2025-07-11T03:30:54+00:00
URL https://multanex.pl/robots.txt
Domain IPs 77.79.221.133, 77.79.221.165
Response IP 77.79.221.133
Found Yes
Hash 984da9fdc9aba939a9ebc126d4bf9dac439ff54d5205cee26cc8ece73f654caa
SimHash 232ca370e621

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /*/p/mail/recommend/
Disallow /*/p/q/
Allow /environment/cache/images/
Disallow /application/
Disallow /environment/
Disallow /libraries/
Disallow /*/fav/add/
Disallow /*/p/comment/add/
Disallow /*/reg/
Disallow /*/login/
Disallow /*/basket/
Disallow /*/searchquery/

amazonbot

Rule Path
Disallow /

Warnings

  • `request-rate` is not a known field.