news.abplive.com
robots.txt
Robots Exclusion Standard data for news.abplive.com
Resource Scan
Scan Details
Site Domain | news.abplive.com |
Base Domain | abplive.com |
Scan Status | Ok |
Last Scan | 2024-06-20T11:25:30+00:00 |
Next Scan | 2024-06-27T11:25:30+00:00 |
Last Scan
Scanned | 2024-06-20T11:25:30+00:00 |
URL | https://news.abplive.com/robots.txt |
Domain IPs | 23.45.207.198, 23.45.207.199, 2600:1413:a000::17d2:fa8b, 2600:1413:a000::17d2:faba |
Response IP | 42.99.140.202 |
Found | Yes |
Hash | 7ffafece9293a7a25a41cbc535e2e86f973c4c900606c2404402fa4d10019eaf |
SimHash | c90c4dc0c693 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /wp-admin/ |
Disallow | /search?s* |
Disallow | /search/page-* |
Disallow | /abp-widget/ |
Disallow | /adsunits/ |
Disallow | /adsunits-a/ |
Disallow | /adsunits-b/ |
Disallow | /adsunits-c/ |
Other Records
Field | Value |
---|---|
sitemap | https://news.abplive.com/news-sitemap.xml |
sitemap | https://news.abplive.com/video-sitemap.xml |
sitemap | https://news.abplive.com/gallery-sitemap.xml |
sitemap | https://news.abplive.com/google-news-sitemap.xml |
sitemap | https://news.abplive.com/web-sitemap.xml |
sitemap | https://news.abplive.com/amp-stories-sitemap.xml |
sitemap | https://news.abplive.com/shortvideo-sitemap.xml |
Comments