topkoszulki.pl
robots.txt

Robots Exclusion Standard data for topkoszulki.pl

Resource Scan

Scan Details

Site Domain topkoszulki.pl
Base Domain topkoszulki.pl
Scan Status Ok
Last Scan2025-07-19T14:45:09+00:00
Next Scan 2025-08-18T14:45:09+00:00

Last Scan

Scanned2025-07-19T14:45:09+00:00
URL https://topkoszulki.pl/robots.txt
Domain IPs 77.79.221.138, 77.79.221.170
Response IP 77.79.221.170
Found Yes
Hash 2fcf4f70a413a2c7cccf97ddb8a8adcbd4f60a07868bb1a3d6b5899336735b25
SimHash e13cbe72a9c6

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /application
Disallow /environment
Allow /environment/cache/images
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add
Disallow /*/p/mail/recommend
Disallow /*/p/q
Disallow /*/reg
Disallow /*/login
Disallow /*/basket
Disallow /*/searchquery
Disallow /*/index/
Disallow /*/full/
Disallow /*/default/
Disallow /*/f_producer
Disallow /*/pricefrom
Disallow /*/priceto
Disallow /*/9088

Warnings

  • `request-rate` is not a known field.