preply.com
robots.txt
Robots Exclusion Standard data for preply.com
Resource Scan
Scan Details
| Site Domain | preply.com |
| Base Domain | preply.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-22T22:00:05+00:00 |
| Next Scan | 2024-11-20T22:00:05+00:00 |
Last Successful Scan
| Scanned | 2023-01-20T17:01:09+00:00 |
| URL | https://preply.com/robots.txt |
| Domain IPs | 104.18.20.180, 104.18.21.180, 2606:4700::6812:14b4, 2606:4700::6812:15b4 |
| Response IP | 104.18.21.180 |
| Found | Yes |
| Hash | a00eda02ab9f10e416d7679137d9d734e12f34624e4d95dc179d541ecede87c3 |
| SimHash | 6e5c1601b070 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /nl/* |
| Disallow | /ro/* |
| Disallow | /language/ |
| Disallow | /*/calendar$ |
| Allow | */help/calendar |
| Disallow | /*/chat/ |
| Disallow | /*/lessons$ |
| Disallow | /currency/ |
| Disallow | /api/ |
| Disallow | /graphql/ |
| Disallow | /dwh/ |
| Disallow | /wp-admin/ |
| Disallow | /edu/ |
| Disallow | */rlogin* |
| Disallow | /current |
| Disallow | /signup |
| Disallow | /*/settings$ |
| Disallow | /*/settings/ |
| Disallow | /redirect_dispatcher |
| Disallow | /*/wizard-portrait |
| Disallow | *?next= |
| Disallow | /messages |
| Disallow | /dashboard |
| Disallow | /tutor |
| Disallow | /ua/tutor |
| Disallow | /pl/tutor |
| Disallow | /pack/*/checkout$ |
| Disallow | /pack/*/edit$ |
| Disallow | /pack/create |
| Disallow | /*bid_history |
| Disallow | */checkout |
| Disallow | */vakancii-dlya-trenerov-angliyskogo-yazyka |
yandex
| Rule | Path |
|---|---|
| Disallow | /en/* |
| Allow | /en/$ |
| Disallow | /es/* |
| Allow | /es/$ |
| Disallow | /ja/* |
| Allow | /ja/$ |
| Disallow | /pl/* |
| Allow | /pl/$ |
| Disallow | /it/* |
| Allow | /it/$ |
| Disallow | /fr/* |
| Allow | /fr/$ |
| Disallow | /pt/* |
| Allow | /pt/$ |
| Disallow | /id/* |
| Allow | /id/$ |
| Disallow | /zh/* |
| Allow | /zh/$ |
| Disallow | /ko/* |
| Allow | /ko/$ |
| Disallow | /de/* |
| Allow | /de/$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://preply.com/special-cases-sitemap.xml |
| sitemap | https://preply.com/ru-sitemap-index.xml |
| sitemap | https://preply.com/en-sitemap-index.xml |
| sitemap | https://preply.com/pl-sitemap-index.xml |
| sitemap | https://preply.com/de-sitemap-index.xml |
| sitemap | https://preply.com/ua-sitemap-index.xml |
| sitemap | https://preply.com/pt-sitemap-index.xml |
| sitemap | https://preply.com/tr-sitemap-index.xml |
| sitemap | https://preply.com/id-sitemap-index.xml |
| sitemap | https://preply.com/fr-sitemap-index.xml |
| sitemap | https://preply.com/it-sitemap-index.xml |
| sitemap | https://preply.com/es-sitemap-index.xml |
| sitemap | https://preply.com/zh-sitemap-index.xml |
| sitemap | https://preply.com/ja-sitemap-index.xml |
| sitemap | https://preply.com/ko-sitemap-index.xml |
| sitemap | https://preply.com/ar-sitemap-index.xml |
| sitemap | https://preply.com/nl-sitemap-index.xml |
| sitemap | https://preply.com/ro-sitemap-index.xml |
| sitemap | https://preply.com/ru/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/pl/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/de/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/pt/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/tr/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/fr/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/it/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/es/blog/sitemap_index.xml/ |
| sitemap | https://preply.com/ja/blog/sitemap_index.xml/ |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.