tapetujemy.pl
robots.txt

Robots Exclusion Standard data for tapetujemy.pl

Resource Scan

Scan Details

Site Domain tapetujemy.pl
Base Domain tapetujemy.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-04T04:15:14+00:00
Next Scan 2025-11-02T04:15:14+00:00

Last Successful Scan

Scanned2025-03-15T01:34:40+00:00
URL https://tapetujemy.pl/robots.txt
Domain IPs 104.26.10.62, 104.26.11.62, 172.67.72.5, 2606:4700:20::681a:a3e, 2606:4700:20::681a:b3e, 2606:4700:20::ac43:4805
Response IP 104.26.11.62
Found Yes
Hash 49b9870e085c8747385ff92187cf724659883564ddabf386646e4ab36b202bbc
SimHash c33f3761cf73

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /application
Disallow /environment
Allow /environment/cache/images
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add
Disallow /*/p/mail/recommend
Disallow /*/p/q
Disallow /*/reg
Disallow /*/login
Disallow /*/basket
Disallow /*/searchquery

*

Rule Path
Disallow /*/*/*/default/
Disallow /*/*/*/full/
Disallow /*/*/*/*/default/
Disallow /*/*/*/*/full/
Disallow /*/*/*/*/*/default/
Disallow /*/*/*/*/*/full/
Disallow /*/*/*/*/*/desc/
Disallow /*/*/*/*/*/name/

Warnings

  • `request-rate` is not a known field.