hindi.asianetnews.com
robots.txt
Robots Exclusion Standard data for hindi.asianetnews.com
Resource Scan
Scan Details
Site Domain | hindi.asianetnews.com |
Base Domain | asianetnews.com |
Scan Status | Ok |
Last Scan | 2024-04-26T17:17:47+00:00 |
Next Scan | 2024-05-03T17:17:47+00:00 |
Last Scan
Scanned | 2024-04-26T17:17:47+00:00 |
URL | https://hindi.asianetnews.com/robots.txt |
Domain IPs | 23.50.89.251, 2600:1413:b000:381::3391, 2600:1413:b000:384::3391 |
Response IP | 104.69.47.167 |
Found | Yes |
Hash | 30d9bb057c5cb361aaa0718e86ca13a6b26dd92783d9570c901f19d0a4f967d5 |
SimHash | 022a58a2c093 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /ad-tags-testing/ |
Disallow | /46138097/ |
Other Records
Field | Value |
---|---|
sitemap | https://hindi.asianetnews.com/latest.xml |
sitemap | https://hindi.asianetnews.com/sitemap.xml |
sitemap | https://hindi.asianetnews.com/image/sitemap.xml |
sitemap | https://hindi.asianetnews.com/news/sitemap.xml |
sitemap | https://hindi.asianetnews.com/gallery/sitemap.xml |
sitemap | https://hindi.asianetnews.com/video/sitemap.xml |
Warnings
- 3 invalid lines.