help.crunchyroll.com
robots.txt
Robots Exclusion Standard data for help.crunchyroll.com
Resource Scan
Scan Details
| Site Domain | help.crunchyroll.com |
| Base Domain | crunchyroll.com |
| Scan Status | Ok |
| Last Scan | 2024-04-28T07:09:43+00:00 |
| Next Scan | 2024-05-28T07:09:43+00:00 |
Last Scan
| Scanned | 2024-04-28T07:09:43+00:00 |
| URL | https://help.crunchyroll.com/robots.txt |
| Domain IPs | 104.16.51.111, 104.16.53.111 |
| Response IP | 104.16.51.111 |
| Found | Yes |
| Hash | c72602135a4589baaf0130a6b6ef104b73aa6513f5b4ccc25e9a210792549d3a |
| SimHash | 0f16994d1f44 |
Groups
applebot
| Product | Comment |
|---|---|
| applebot | Allow /tickets |
| Rule | Path |
|---|---|
| Disallow | /children |
| Disallow | /groups |
| Disallow | /organizations |
| Disallow | /requests |
| Disallow | /registration |
| Disallow | /plans |
| Disallow | /accounts |
| Disallow | /account |
| Disallow | /proxy |
| Disallow | /rules |
| Disallow | /tags |
| Disallow | /ticket_fields |
| Disallow | /reports |
| Disallow | /search |
| Disallow | /slas |
| Disallow | /integrations |
| Disallow | /users |
| Disallow | /suspended_tickets |
| Disallow | /events |
| Disallow | /console |
| Disallow | /requests/*/satisfaction/ |
| Disallow | /hc/change_language/ |
| Disallow | /hc/communities/public/topics/*?*filter= |
| Disallow | /hc/communities/public/questions$ |
| Disallow | /hc/communities/public/questions?*filter= |
| Disallow | /hc/communities/public/questions/unanswered |
| Disallow | /hc/*/signin |
| Disallow | /hc/requests/ |
| Disallow | /hc/*/requests/ |
| Allow | /hc/*/requests/new |
| Disallow | /hc/*/search |
| Disallow | /access/normal |
| Disallow | /access/sso_bypass |
| Disallow | /access/unauthenticated |
| Disallow | /theming |
| Disallow | /knowledge |
| Disallow | /access/ |
*
| Rule | Path |
|---|---|
| Disallow | /children |
| Disallow | /groups |
| Disallow | /organizations |
| Disallow | /requests |
| Disallow | /registration |
| Disallow | /plans |
| Disallow | /accounts |
| Disallow | /account |
| Disallow | /proxy |
| Disallow | /rules |
| Disallow | /tags |
| Disallow | /ticket_fields |
| Disallow | /reports |
| Disallow | /search |
| Disallow | /slas |
| Disallow | /integrations |
| Disallow | /users |
| Disallow | /suspended_tickets |
| Disallow | /events |
| Disallow | /console |
| Disallow | /requests/*/satisfaction/ |
| Disallow | /hc/change_language/ |
| Disallow | /hc/communities/public/topics/*?*filter= |
| Disallow | /hc/communities/public/questions$ |
| Disallow | /hc/communities/public/questions?*filter= |
| Disallow | /hc/communities/public/questions/unanswered |
| Disallow | /hc/*/signin |
| Disallow | /hc/requests/ |
| Disallow | /hc/*/requests/ |
| Allow | /hc/*/requests/new |
| Disallow | /hc/*/search |
| Disallow | /access/normal |
| Disallow | /access/sso_bypass |
| Disallow | /access/unauthenticated |
| Disallow | /theming |
| Disallow | /knowledge |
| Disallow | /access/ |
| Disallow | /tickets |
Other Records
| Field | Value |
|---|---|
| sitemap | https://help.crunchyroll.com/hc/sitemap.xml |
Comments