gotexbudowlane.com.pl
robots.txt

Robots Exclusion Standard data for gotexbudowlane.com.pl

Resource Scan

Scan Details

Site Domain gotexbudowlane.com.pl
Base Domain gotexbudowlane.com.pl
Scan Status Ok
Last Scan2025-04-03T00:33:13+00:00
Next Scan 2025-05-03T00:33:13+00:00

Last Scan

Scanned2025-04-03T00:33:13+00:00
URL https://gotexbudowlane.com.pl/robots.txt
Domain IPs 77.79.221.135, 77.79.221.167
Response IP 77.79.221.135
Found Yes
Hash b8a70fed238bac85b161511d33af4753a95477a02155443c00deab409266f284
SimHash e134bd74ffd7

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /application
Disallow /environment
Allow /environment/cache/images
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add
Disallow /*/p/mail/recommend
Disallow /*/p/q
Disallow /*/reg
Disallow /*/login
Disallow /*/basket
Disallow /*/searchquery
Disallow */full*
Disallow */default*
Disallow /pl/promotions/
Disallow /pl/index/

Warnings

  • `request-rate` is not a known field.