telugupost.com
robots.txt

Robots Exclusion Standard data for telugupost.com

Resource Scan

Scan Details

Site Domain telugupost.com
Base Domain telugupost.com
Scan Status Ok
Last Scan2024-11-15T08:27:12+00:00
Next Scan 2024-11-22T08:27:12+00:00

Last Scan

Scanned2024-11-15T08:27:12+00:00
URL https://telugupost.com/robots.txt
Redirect https://www.telugupost.com/robots.txt
Redirect Domain www.telugupost.com
Redirect Base telugupost.com
Domain IPs 104.21.92.17, 172.67.184.249, 2606:4700:3034::ac43:b8f9, 2606:4700:3036::6815:5c11
Redirect IPs 104.21.92.17, 172.67.184.249, 2606:4700:3034::ac43:b8f9, 2606:4700:3036::6815:5c11
Response IP 172.67.184.249
Found Yes
Hash 3d69d66c8695fbc973bad7e45d3f73655aacf3d4ba12eb77369d6167185927c4
SimHash 810a1e47cdd7

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /video-only-for-doctors-72491
Disallow /introducing-medical-dialogues-medical-and-health-news-portal-74410
Disallow /metsmall
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://telugu.telugupost.com/sitemap/sitemap-index.xml
sitemap https://telugu.telugupost.com/news-sitemap-daily.xml
sitemap https://telugu.telugupost.com/feeds.xml

Comments

  • robots.txt for https://telugu.telugupost.com/