navbharatlive.com
robots.txt

Robots Exclusion Standard data for navbharatlive.com

Resource Scan

Scan Details

Site Domain navbharatlive.com
Base Domain navbharatlive.com
Scan Status Ok
Last Scan2024-09-25T19:24:35+00:00
Next Scan 2024-10-02T19:24:35+00:00

Last Scan

Scanned2024-09-25T19:24:35+00:00
URL https://navbharatlive.com/robots.txt
Domain IPs 54.230.71.111, 54.230.71.46, 54.230.71.72, 54.230.71.76
Response IP 13.227.254.125
Found Yes
Hash 023cc124c41903bc60c74024b3a21af460d1f37cc8b114f3fa508353ec0d6858
SimHash 6840586989a3

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /?page=*
Disallow /sponsored/
Disallow /brand-solution/
Disallow */tag/*
Disallow */page/*
Disallow */topic/*
Disallow */article/*
Disallow */article-sitemap/*
Disallow */detail-video-sitemap/*
Disallow */photogallery-sitemap/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili
omgilibot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://navbharatlive.com/news-sitemap.xml
sitemap https://navbharatlive.com/sitemap_index.xml
sitemap https://navbharatlive.com/web-story-sitemap.xml
sitemap https://navbharatlive.com/category-sitemap.xml
sitemap https://navbharatlive.com/gallery-sitemap.xml
sitemap https://navbharatlive.com/video-sitemap.xml
sitemap https://navbharatlive.com/page-sitemap.xml