abpmajha.abplive.in
robots.txt

Robots Exclusion Standard data for abpmajha.abplive.in

Resource Scan

Scan Details

Site Domain abpmajha.abplive.in
Base Domain abplive.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-05T14:42:29+00:00
Next Scan 2025-01-03T14:42:29+00:00

Last Successful Scan

Scanned2023-11-18T14:07:22+00:00
URL https://abpmajha.abplive.in/robots.txt
Domain IPs 173.222.148.40, 173.222.148.49
Response IP 42.99.140.160
Found Yes
Hash b9377b333ae1e918ff1d5e39903dc933d2778dfb17a3e08a808f0ccc332c2342
SimHash 6d48cf4149a2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow *?replytocom
Disallow /comments/
Disallow /sponsored/
Disallow /search?s*

googlebot-news

Rule Path
Disallow /topic/

Other Records

Field Value
sitemap https://abpmajha.abplive.in/google-news-sitemap.xml
sitemap https://abpmajha.abplive.in/index-sitemap.xml
sitemap https://abpmajha.abplive.in/News-2018-2-sitemap.xml
sitemap https://abpmajha.abplive.in/Gallery-2018-2-sitemap.xml
sitemap https://abpmajha.abplive.in/Videos-2018-2-sitemap.xml

Comments

  • disallow all files in these directories
  • Sitemaps