magazine.ynetnews.com
robots.txt
Robots Exclusion Standard data for magazine.ynetnews.com
Resource Scan
Scan Details
Site Domain | magazine.ynetnews.com |
Base Domain | ynetnews.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-05-29T03:52:26+00:00 |
Next Scan | 2024-08-27T03:52:26+00:00 |
Last Successful Scan
Scanned | 2024-01-31T03:44:44+00:00 |
URL | https://magazine.ynetnews.com/robots.txt |
Domain IPs | 13.33.33.13, 13.33.33.40, 13.33.33.74, 13.33.33.81, 2600:9000:229f:1a00:1b:1910:19c0:93a1, 2600:9000:229f:4000:1b:1910:19c0:93a1, 2600:9000:229f:4600:1b:1910:19c0:93a1, 2600:9000:229f:4e00:1b:1910:19c0:93a1, 2600:9000:229f:ca00:1b:1910:19c0:93a1, 2600:9000:229f:d000:1b:1910:19c0:93a1, 2600:9000:229f:d600:1b:1910:19c0:93a1, 2600:9000:229f:e800:1b:1910:19c0:93a1 |
Response IP | 52.222.214.107 |
Found | Yes |
Hash | 0d42491e943055aad48c62f94ededd97819f4e2e3a3795e411b195dcd8eba2a7 |
SimHash | 4100c0400531 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/ |
Disallow | /wp-content/themes/main/assets/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-admin/ |
Disallow | /readme.html |
Disallow | /refer/ |