teluguglobal.in
robots.txt

Robots Exclusion Standard data for teluguglobal.in

Resource Scan

Scan Details

Site Domain teluguglobal.in
Base Domain teluguglobal.in
Scan Status Ok
Last Scan2024-06-23T15:37:18+00:00
Next Scan 2024-06-30T15:37:18+00:00

Last Scan

Scanned2024-06-23T15:37:18+00:00
URL http://teluguglobal.in/robots.txt
Redirect https://www.teluguglobal.com/robots.txt
Redirect Domain www.teluguglobal.com
Redirect Base teluguglobal.com
Domain IPs 164.52.221.36
Redirect IPs 164.52.221.36
Response IP 164.52.221.36
Found Yes
Hash f4781053c0380f5aedfd8b8522b3d24e6fb5124596fc2a81f2a159e88e9012de
SimHash 82521e45cd83

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.teluguglobal.com/sitemap/sitemap-index.xml
sitemap https://www.teluguglobal.com/news-sitemap-daily.xml
sitemap https://www.teluguglobal.com/feeds.xml

Comments

  • robots.txt for https://www.teluguglobal.com/