abpsanjha.abplive.in
robots.txt

Robots Exclusion Standard data for abpsanjha.abplive.in

Resource Scan

Scan Details

Site Domain abpsanjha.abplive.in
Base Domain abplive.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-07-10T03:14:23+00:00
Next Scan 2024-10-08T03:14:23+00:00

Last Successful Scan

Scanned2023-12-06T22:00:09+00:00
URL https://abpsanjha.abplive.in/robots.txt
Domain IPs 184.87.193.71, 184.87.193.80
Response IP 42.99.140.201
Found Yes
Hash 699e81942e0e4612f8d752ad541c338e7706959445aae0a5263adca02de3c775
SimHash 6c4ccf5445b0

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow *?replytocom
Disallow /comments/
Disallow /sponsored/
Disallow /search?s*

googlebot-news

Rule Path
Disallow /topic/

Other Records

Field Value
sitemap https://abpsanjha.abplive.in/google-news-sitemap.xml
sitemap https://abpsanjha.abplive.in/index-sitemap.xml
sitemap https://abpsanjha.abplive.in/News-2018-2-sitemap.xml
sitemap https://abpsanjha.abplive.in/Gallery-2018-2-sitemap.xml
sitemap https://abpsanjha.abplive.in/Videos-2018-2-sitemap.xml

Comments

  • disallow all files in these directories
  • Sitemaps