hexlet.io
robots.txt
Robots Exclusion Standard data for hexlet.io
Resource Scan
Scan Details
| Site Domain | hexlet.io |
| Base Domain | hexlet.io |
| Scan Status | Ok |
| Last Scan | 4/27/2025, 5:50:16 PM |
| Next Scan | 5/27/2025, 5:50:16 PM |
Last Scan
| Scanned | 4/27/2025, 5:50:16 PM |
| URL | https://hexlet.io/robots.txt |
| Domain IPs | 104.26.0.213, 104.26.1.213, 172.67.73.203, 2606:4700:20::681a:1d5, 2606:4700:20::681a:d5, 2606:4700:20::ac43:49cb |
| Response IP | 172.67.73.203 |
| Found | Yes |
| Hash | edfb6745944740c8c023b95694079e3557e38325c374b46a9b4fa0ec13b84b70 |
| SimHash | c05d62c0ae7d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /content_teams/ |
| Disallow | /marketing |
| Disallow | /mentorship |
| Disallow | /hr/ |
| Disallow | /search?* |
| Disallow | /challenges/*/instance$ |
| Disallow | /password/ |
| Disallow | /*? |
| Disallow | /~* |
| Disallow | /ses* |
| Disallow | /manage* |
| Disallow | */u/user- |
| Disallow | /pages/offer |
| Disallow | */lead$ |
| Disallow | */lead_created$ |
| Disallow | */goto$ |
| Disallow | /my$ |
| Disallow | /my/ |
| Disallow | /companies/ |
| Disallow | /tutorship/ |
| Disallow | /projects/* |
| Disallow | */settings$ |
| Disallow | /teams/ |
| Allow | *?page= |
| Disallow | */u/ |
| Disallow | /webinars |
| Disallow | /qna |
| Disallow | /categories/sandbox/courses |
| Disallow | /pages/tos |
| Disallow | /pages/privacy |
| Disallow | /pages/cookie_policy |
| Disallow | /testimonials |
| Disallow | /instances/ |
| Disallow | */finish_unit |
| Disallow | */exercise_unit |
| Disallow | */quiz_unit |
| Disallow | */lead/success |
yandex
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /content_teams/ |
| Disallow | /marketing |
| Disallow | /mentorship |
| Disallow | /hr/ |
| Disallow | /search?* |
| Disallow | /challenges/*/instance$ |
| Disallow | /password/ |
| Disallow | /*? |
| Disallow | /~* |
| Disallow | /ses* |
| Disallow | /manage* |
| Disallow | */lead_created$ |
| Disallow | */u/user- |
| Disallow | /pages/offer |
| Disallow | /pages/tos |
| Disallow | */lead$ |
| Disallow | */goto$ |
| Disallow | /my$ |
| Disallow | /my/ |
| Disallow | /teams/new |
| Disallow | /companies/ |
| Disallow | /tutorship/ |
| Disallow | /projects/* |
| Disallow | */settings$ |
| Disallow | *.amp$ |
| Disallow | /teams/ |
| Disallow | /pricing |
| Disallow | /code_reviews/* |
| Disallow | /instances/ |
| Disallow | */finish_unit |
| Disallow | */exercise_unit |
| Disallow | */quiz_unit |
| Allow | *utm_source%3D |
| Allow | *ved%3D |
| Allow | *per%3D |
| Allow | *q%3D |
| Allow | *ref%3D |
| Allow | *usg%3D |
| Allow | *utm_medium%3D |
| Allow | *vgo_ee%3D |
| Allow | *user%3D |
| Allow | *utm_campaign%3D |
| Allow | *utm_content%3D |
| Allow | *advcake_params%3D |
| Allow | *utm_term%3D |
| Allow | *erid%3D |
| Allow | *keyword%3D |
| Allow | *sub1%3D |
| Allow | *sub2%3D |
| Allow | *sub3%3D |
| Allow | *yclid%3D |
| Allow | *sub_id%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hexlet.io/sitemaps/en/sitemap.xml.gz |
Warnings
- `clean-param` is not a known field.