proglib.tech
robots.txt
Robots Exclusion Standard data for proglib.tech
Resource Scan
Scan Details
| Site Domain | proglib.tech |
| Base Domain | proglib.tech |
| Scan Status | Ok |
| Last Scan | 2025-08-22T03:25:35+00:00 |
| Next Scan | 2025-08-29T03:25:35+00:00 |
Last Scan
| Scanned | 2025-08-22T03:25:35+00:00 |
| URL | https://proglib.tech/robots.txt |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.112.1 |
| Found | Yes |
| Hash | 585ef6ca8cd71124260ec496ae6142c8ce5c46d0add80f83b2f06c140963c349 |
| SimHash | c22cdc82a333 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /search |
| Disallow | /me |
| Disallow | /me/bookmarks |
| Disallow | /me/comments |
| Disallow | /me/tests |
| Disallow | /me/publications |
| Disallow | /me/notifications |
| Disallow | /me/subscriptions |
| Disallow | /p/new-post |
| Disallow | /centrifuge/refresh |
| Disallow | /sh/* |
| Disallow | /*? |
| Disallow | /*%26city |
| Disallow | */c/*contacts |
| Disallow | */c/*ambassadors |
| Disallow | */c/*vacancies |
| Disallow | */c/*events |
| Disallow | */c/*posts |
| Disallow | */u/*comments |
| Disallow | */u/*tests |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
| Allow | /feed |
| Allow | /*page |
| Disallow | /*%26*page%3D |
| Disallow | /*/fake$ |
| Disallow | /p/*?*comment= |
| Disallow | /index.php |
yandex
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /search |
| Disallow | /me |
| Disallow | /me/bookmarks |
| Disallow | /me/comments |
| Disallow | /me/tests |
| Disallow | /me/publications |
| Disallow | /me/notifications |
| Disallow | /me/subscriptions |
| Disallow | /p/new-post |
| Disallow | /centrifuge/refresh |
| Disallow | /sh/* |
| Disallow | /*? |
| Disallow | /*%26city |
| Disallow | */c/*contacts |
| Disallow | */c/*ambassadors |
| Disallow | */c/*vacancies |
| Disallow | */c/*events |
| Disallow | */c/*posts |
| Disallow | */u/*comments |
| Disallow | */u/*tests |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
| Allow | /feed |
| Allow | /*page |
| Disallow | /*%26*page%3D |
| Disallow | /*/fake$ |
| Disallow | /index.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://proglib.io/sitemap.xml |
| sitemap | https://proglib.io/sitemap.xml |
Warnings
- `clean-param` is not a known field.