abplive.in
robots.txt

Robots Exclusion Standard data for abplive.in

Resource Scan

Scan Details

Site Domain abplive.in
Base Domain abplive.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-05-29T13:32:17+00:00
Next Scan 2025-06-05T13:32:17+00:00

Last Successful Scan

Scanned2023-04-21T18:32:56+00:00
URL https://abplive.in/robots.txt
Redirect https://www.abplive.in/robots.txt
Redirect Domain www.abplive.in
Redirect Base abplive.in
Domain IPs 23.49.60.43, 23.49.60.49
Redirect IPs 72.247.81.152, 72.247.81.171
Response IP 42.99.140.216
Found Yes
Hash e4e2fb437cb202fdba8bedc53fb231340598ee467b0988a16b213772db80be17
SimHash 6d4c7752d193

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow *?replytocom
Disallow /comments/
Disallow /.well-known/amphtml/apikey.pub
Disallow /search?s*

googlebot-news

Rule Path
Disallow /topic/

Other Records

Field Value
sitemap https://www.abplive.in/google-news-sitemap.xml
sitemap https://www.abplive.in/gallery-sitemap.xml
sitemap https://www.abplive.in/video-sitemap.xml

Comments

  • disallow all files in these directories
  • Sitemaps