meble-handmade.pl
robots.txt

Robots Exclusion Standard data for meble-handmade.pl

Resource Scan

Scan Details

Site Domain meble-handmade.pl
Base Domain meble-handmade.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-05T02:06:17+00:00
Next Scan 2025-07-04T02:06:17+00:00

Last Successful Scan

Scanned2024-08-16T01:35:58+00:00
URL http://meble-handmade.pl/robots.txt
Domain IPs 77.79.221.129, 77.79.221.161
Response IP 77.79.221.161
Found Yes
Hash 4ba6647e868b476d1008b5bdc554f870ec5b5b6dd2988540a1d1da0f1d64005f
SimHash e13d3d50cdd7

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /application
Disallow /environment
Allow /environment/cache/images
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add
Disallow /*/p/mail/recommend
Disallow /*/p/q
Disallow /*/reg
Disallow /*/login
Disallow /*/basket
Disallow /*/searchquery

Warnings

  • `request-rate` is not a known field.