ygopro.co
robots.txt
Robots Exclusion Standard data for ygopro.co
Resource Scan
Scan Details
| Site Domain | ygopro.co |
| Base Domain | ygopro.co |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-08-16T01:26:40+00:00 |
| Next Scan | 2024-11-14T01:26:40+00:00 |
Last Successful Scan
| Scanned | 2023-06-27T19:11:59+00:00 |
| URL | https://www.ygopro.co/robots.txt |
| Domain IPs | 104.21.53.154, 172.67.214.157, 2606:4700:3032::6815:359a, 2606:4700:3034::ac43:d69d |
| Response IP | 172.67.214.157 |
| Found | Yes |
| Hash | 05886b3b4ad2e5f018fab9f2e3dcef3a05054c7b9c5aa9befa3ae592fd8300cb |
| SimHash | 3805594ba6c2 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /bin/ | - |
| Disallow | /Content/ | - |
| Disallow | /Controls/ | - |
| Disallow | /Dialogs/ | - |
| Disallow | /Images/ | - |
| Disallow | /Install/ | - |
| Disallow | /languages/ | - |
| Disallow | /Pages/ | - |
| Disallow | /Pages/Admin/ | - |
| Disallow | /Pages/Moderate/ | - |
| Disallow | /Resources/ | - |
| Disallow | /Boards/ | - |
| Disallow | /Scripts/ | - |
| Disallow | /Upload/ | - |
| Disallow | /YafAjax.asmx | - |
| Disallow | /ScriptResource.axd | - |
| Disallow | /WebResource.axd | - |
| Disallow | /Profile/ | Do not index user profiles |
Comments