tapetuj.pl
robots.txt
Robots Exclusion Standard data for tapetuj.pl
Resource Scan
Scan Details
| Site Domain | tapetuj.pl |
| Base Domain | tapetuj.pl |
| Scan Status | Ok |
| Last Scan | 2025-09-20T18:23:32+00:00 |
| Next Scan | 2025-10-20T18:23:32+00:00 |
Last Scan
| Scanned | 2025-09-20T18:23:32+00:00 |
| URL | https://tapetuj.pl/robots.txt |
| Domain IPs | 104.26.10.44, 104.26.11.44, 172.67.74.48, 2606:4700:20::681a:a2c, 2606:4700:20::681a:b2c, 2606:4700:20::ac43:4a30 |
| Response IP | 104.26.10.44 |
| Found | Yes |
| Hash | 676e9f9c90714c6c7fb5645f7b443c1d6e9a0472c8206ded523ca74f5fbc431c |
| SimHash | e3bf0171cf03 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /application |
| Disallow | /environment |
| Allow | /environment/cache/images |
| Disallow | /libraries |
| Disallow | /*/fav/add |
| Disallow | /*/p/comment/add |
| Disallow | /*/p/mail/recommend |
| Disallow | /*/p/q |
| Disallow | /*/reg |
| Disallow | /*/login |
| Disallow | /*/basket |
| Disallow | /*/searchquery |
| Disallow | /*/*/*/default/ |
| Disallow | /*/*/*/full/ |
| Disallow | /*/*/*/desc/ |
| Disallow | /*/*/*/name/ |
| Disallow | /*/*/*/*/default/ |
| Disallow | /*/*/*/*/full/ |
| Disallow | /*/*/*/*/desc/ |
| Disallow | /*/*/*/*/name/ |
| Disallow | /*/*/*/*/*/default/ |
| Disallow | /*/*/*/*/*/full/ |
| Disallow | /*/*/*/*/*/desc/ |
| Disallow | /*/*/*/*/*/name/ |
Warnings
- `request-rate` is not a known field.