setnews.net
robots.txt
Robots Exclusion Standard data for setnews.net
Resource Scan
Scan Details
| Site Domain | setnews.net |
| Base Domain | setnews.net |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-06T22:19:16+00:00 |
| Next Scan | 2024-12-05T22:19:16+00:00 |
Last Successful Scan
| Scanned | 2022-10-22T09:06:35+00:00 |
| URL | http://setnews.net/robots.txt |
| Redirect | https://www.setn.com/robots.txt |
| Redirect Domain | www.setn.com |
| Redirect Base | setn.com |
| Response IP | 13.33.88.103, 13.33.88.109, 13.33.88.55, 13.33.88.59 |
| Found | Yes |
| Hash | c2ae7ba8262036c1d4423eb5d1ba9341707d887a5984cc75a986aa2ae0577287 |
| SimHash | e858a0a4eb70 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*search.aspx* |
| Disallow | /Exten |
| Disallow | /VOD.aspx |
| Disallow | /jjinhouse* |
| Disallow | /default.aspx/ |
| Disallow | /Default.aspx/ |
| Disallow | /m/default.aspx/ |
| Disallow | /m/Default.aspx/ |