4shoes.com.pl
robots.txt

Robots Exclusion Standard data for 4shoes.com.pl

Resource Scan

Scan Details

Site Domain 4shoes.com.pl
Base Domain 4shoes.com.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-18T07:59:32+00:00
Next Scan 2026-01-25T07:59:32+00:00

Last Successful Scan

Scanned2025-12-18T07:47:51+00:00
URL https://4shoes.com.pl/robots.txt
Domain IPs 77.79.221.146, 77.79.221.178
Response IP 77.79.221.146
Found Yes
Hash 7d9fb075cce31393d1fb94840cd7e3a40238acd35a47efb30d4cc8330b48583e
SimHash c13c3c70cfa3

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /environment/cache/images
Disallow /application
Disallow /environment
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add
Disallow /*/p/mail/recommend
Disallow /*/p/q
Disallow /*/reg
Disallow /*/login
Disallow /*/basket
Disallow /*/searchquery
Disallow /Kontakt
Disallow /Regulamin
Disallow /Polityka-prywatnosci

Warnings

  • `request-rate` is not a known field.