shacho-college.com
robots.txt
Robots Exclusion Standard data for shacho-college.com
Resource Scan
Scan Details
| Site Domain | shacho-college.com |
| Base Domain | shacho-college.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-15T18:16:46+00:00 |
| Next Scan | 2024-10-13T18:16:46+00:00 |
Last Successful Scan
| Scanned | 2024-03-16T19:25:54+00:00 |
| URL | https://shacho-college.com/robots.txt |
| Domain IPs | 52.84.229.112, 52.84.229.25, 52.84.229.68, 52.84.229.89 |
| Response IP | 52.84.229.68 |
| Found | Yes |
| Hash | cc17e11cb5c3b3f79c614db4efa67ba58bdc6831bbad20d3c1f675c8fd5fd489 |
| SimHash | 2c16de46eb81 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ahoy/ |
| Disallow | /api/ |
| Disallow | /admin/ |
| Disallow | /courses/*/lectures/ |
| Disallow | /ja/courses/*/lectures/ |
| Disallow | /en/courses/*/lectures/ |
| Disallow | /vi/courses/*/lectures/ |
| Disallow | /zh-CN/courses/*/lectures/ |
| Disallow | /zh-TW/courses/*/lectures/ |
| Disallow | /pt-BR/courses/*/lectures/ |
| Disallow | /ko/courses/*/lectures/ |
| Disallow | /users/my_courses/ |
| Disallow | /users/settings/ |
| Disallow | /ja/users/settings/ |
| Disallow | /en/users/settings/ |
| Disallow | /vi/users/settings/ |
| Disallow | /zh-CN/users/settings/ |
| Disallow | /zh-TW/users/settings/ |
| Disallow | /pt-BR/users/settings/ |
| Disallow | /ko/users/settings/ |
| Disallow | /users/my_profile/ |
| Disallow | /users/purchase_history/ |
| Disallow | /courses?*query= |
| Disallow | /ja/courses?*query= |
| Disallow | /en/courses?*query= |
| Disallow | /vi/courses?*query= |
| Disallow | /ko/courses?*query= |
| Disallow | /pt-BR/courses?*query= |
| Disallow | /zh-CN/courses?*query= |
| Disallow | /zh-TW/courses?*query= |
| Disallow | /about |
| Disallow | /ja/about |
| Disallow | /en/about |
| Disallow | /vi/about |
| Disallow | /ko/about |
| Disallow | /pt-BR/about |
| Disallow | /zh-CN/about |
| Disallow | /zh-TW/about |
| Disallow | /tos |
| Disallow | /ja/tos |
| Disallow | /en/tos |
| Disallow | /vi/tos |
| Disallow | /ko/tos |
| Disallow | /pt-BR/tos |
| Disallow | /zh-CN/tos |
| Disallow | /zh-TW/tos |
| Disallow | /tokusyo |
| Disallow | /privacy |
| Disallow | /ja/privacy |
| Disallow | /en/privacy |
| Disallow | /vi/privacy |
| Disallow | /ko/privacy |
| Disallow | /pt-BR/privacy |
| Disallow | /zh-CN/privacy |
| Disallow | /zh-TW/privacy |
| Disallow | /premium_accounts/ |
| Disallow | /premium_payment_infos/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shacho-college.com/sitemap.xml.gz |