news9live.com
robots.txt

Robots Exclusion Standard data for news9live.com

Resource Scan

Scan Details

Site Domain news9live.com
Base Domain news9live.com
Scan Status Ok
Last Scan2024-06-12T23:22:42+00:00
Next Scan 2024-06-19T23:22:42+00:00

Last Scan

Scanned2024-06-12T23:22:42+00:00
URL https://news9live.com/robots.txt
Redirect https://www.news9live.com/robots.txt
Redirect Domain www.news9live.com
Redirect Base news9live.com
Domain IPs 13.33.30.129, 13.33.30.22, 13.33.30.65, 13.33.30.66
Redirect IPs 13.33.30.129, 13.33.30.22, 13.33.30.65, 13.33.30.66
Response IP 13.33.30.66
Found Yes
Hash f8aeb00abb19e5da02a3d6cfd9eb27741a4eaecd5bddd244a38c5f7d81e0e292
SimHash 125cc864c931

Groups

*

Rule Path
Allow /
Disallow /sports/cricket-news/player-profile/
Disallow /elections/*/constituencies/*
Disallow /elections/*/candidates/*
Disallow /wp-json/
Disallow *fb_noscript%3D*
Disallow /search?*

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.news9live.com/news-sitemap.xml
sitemap https://www.news9live.com/gallery-sitemap.xml
sitemap https://www.news9live.com/video-sitemap.xml
sitemap https://www.news9live.com/category-sitemap.xml
sitemap https://www.news9live.com/page-sitemap.xml
sitemap https://www.news9live.com/web-story-sitemap.xml

Comments

  • Baiduspider
  • Yandex
  • Majestic