abpmajha.newsbullet.in
robots.txt

Robots Exclusion Standard data for abpmajha.newsbullet.in

Resource Scan

Scan Details

Site Domain abpmajha.newsbullet.in
Base Domain newsbullet.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-06T14:09:13+00:00
Next Scan 2024-07-05T14:09:13+00:00

Last Successful Scan

Scanned2023-12-02T02:52:25+00:00
URL http://abpmajha.newsbullet.in/robots.txt
Redirect https://abpmajha.abplive.in/robots.txt
Redirect Domain abpmajha.abplive.in
Redirect Base abplive.in
Redirect IPs 125.56.219.49, 96.17.72.17
Response IP 42.99.140.211
Found Yes
Hash b9377b333ae1e918ff1d5e39903dc933d2778dfb17a3e08a808f0ccc332c2342
SimHash 6d48cf4149a2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow *?replytocom
Disallow /comments/
Disallow /sponsored/
Disallow /search?s*

googlebot-news

Rule Path
Disallow /topic/

Other Records

Field Value
sitemap https://abpmajha.abplive.in/google-news-sitemap.xml
sitemap https://abpmajha.abplive.in/index-sitemap.xml
sitemap https://abpmajha.abplive.in/News-2018-2-sitemap.xml
sitemap https://abpmajha.abplive.in/Gallery-2018-2-sitemap.xml
sitemap https://abpmajha.abplive.in/Videos-2018-2-sitemap.xml

Comments

  • disallow all files in these directories
  • Sitemaps