qna.habr.com
robots.txt
Robots Exclusion Standard data for qna.habr.com
Resource Scan
Scan Details
| Site Domain | qna.habr.com |
| Base Domain | habr.com |
| Scan Status | Ok |
| Last Scan | 2024-05-11T16:45:55+00:00 |
| Next Scan | 2024-06-10T16:45:55+00:00 |
Last Scan
| Scanned | 2024-05-11T16:45:55+00:00 |
| URL | https://qna.habr.com/robots.txt |
| Domain IPs | 178.248.233.33 |
| Response IP | 178.248.233.33 |
| Found | Yes |
| Hash | 1e912c281561c2d8ca728b9b4c8ac323848afbff6f27b1d3e5bd0cbee7167074 |
| SimHash | 415dce540b30 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /q |
| Allow | /tag |
| Allow | /info |
| Allow | /help |
| Allow | /tags |
| Allow | /user |
| Allow | /users |
| Allow | /questions |
| Disallow | /user/*/tags |
| Disallow | /user/*/questions |
| Disallow | /user/*/iquestions |
| Disallow | /questions/related |
| Disallow | /search |
| Disallow | /question/ |
| Disallow | /auth/ |
| Disallow | /feedback |
| Disallow | /answer |
Other Records
| Field | Value |
|---|---|
| sitemap | https://qna.habr.com/sm-index.xml |