aninews.in
robots.txt
Robots Exclusion Standard data for aninews.in
Resource Scan
Scan Details
| Site Domain | aninews.in |
| Base Domain | aninews.in |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-26T17:01:55+00:00 |
| Next Scan | 2024-11-24T17:01:55+00:00 |
Last Successful Scan
| Scanned | 2023-05-05T16:19:38+00:00 |
| URL | https://aninews.in/robots.txt |
| Domain IPs | 13.126.121.254 |
| Response IP | 13.126.121.254 |
| Found | Yes |
| Hash | b681796c9bbf451ae6eec15e4c5c71a7c607e4f3a465b16a5670d43eabc549cc |
| SimHash | 6d056d45cd90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /category/alexa/ |
| Disallow | /news/alexa/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aninews.in/google-news-sitemap.xml |
| sitemap | https://www.aninews.in/sitemap.xml |