share-wis.com
robots.txt
Robots Exclusion Standard data for share-wis.com
Resource Scan
Scan Details
| Site Domain | share-wis.com |
| Base Domain | share-wis.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-23T16:53:22+00:00 |
| Next Scan | 2024-11-21T16:53:22+00:00 |
Last Successful Scan
| Scanned | 2024-01-27T16:39:28+00:00 |
| URL | https://share-wis.com/robots.txt |
| Domain IPs | 18.155.68.104, 18.155.68.2, 18.155.68.91, 18.155.68.95 |
| Response IP | 13.32.145.45 |
| Found | Yes |
| Hash | a05d8d0feb3d62a81fbeff9016bd164423e4c64aa1c90338be591fc02be473a6 |
| SimHash | 6e01de55ee81 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ahoy/ |
| Disallow | /api/ |
| Disallow | /admin/ |
| Disallow | /courses/*/lectures/ |
| Disallow | /ja/courses/*/lectures/ |
| Disallow | /en/courses/*/lectures/ |
| Disallow | /vi/courses/*/lectures/ |
| Disallow | /zh-CN/courses/*/lectures/ |
| Disallow | /zh-TW/courses/*/lectures/ |
| Disallow | /pt-BR/courses/*/lectures/ |
| Disallow | /ko/courses/*/lectures/ |
| Disallow | /users/my_courses/ |
| Disallow | /users/settings/ |
| Disallow | /ja/users/settings/ |
| Disallow | /en/users/settings/ |
| Disallow | /vi/users/settings/ |
| Disallow | /zh-CN/users/settings/ |
| Disallow | /zh-TW/users/settings/ |
| Disallow | /pt-BR/users/settings/ |
| Disallow | /ko/users/settings/ |
| Disallow | /users/my_profile/ |
| Disallow | /users/purchase_history/ |
| Disallow | /premium_accounts/ |
| Disallow | /business/ |
| Disallow | /courses?*query= |
| Disallow | /ja/courses?*query= |
| Disallow | /en/courses?*query= |
| Disallow | /vi/courses?*query= |
| Disallow | /ko/courses?*query= |
| Disallow | /pt-BR/courses?*query= |
| Disallow | /zh-CN/courses?*query= |
| Disallow | /zh-TW/courses?*query= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://share-wis.com/sitemap.xml.gz |