rediff.co.in
robots.txt

Robots Exclusion Standard data for rediff.co.in

Resource Scan

Scan Details

Site Domain rediff.co.in
Base Domain rediff.co.in
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-27T02:29:07+00:00
Next Scan 2024-09-28T02:29:07+00:00

Last Successful Scan

Scanned2024-09-20T02:21:59+00:00
URL http://rediff.co.in/robots.txt
Redirect http://www.rediff.com/robots.txt
Redirect Domain www.rediff.com
Redirect Base rediff.com
Domain IPs 202.137.236.33
Redirect IPs 23.209.46.152, 23.209.46.154, 2600:1413:b000:1b::17d7:709, 2600:1413:b000:1b::17d7:70a
Response IP 23.32.29.11
Found Yes
Hash 3840b1c645eda4403ac56bdcc7789b0fbe23475974e737554fa3c630afefcd1b
SimHash 2401bf483793

Groups

*

Rule Path
Disallow /uim/
Disallow /images/
Disallow /messageboard/
Disallow /newsletters/
Disallow /cms/print.jsp

Other Records

Field Value
sitemap https://www.rediff.com/sitemap.xml
sitemap https://www.rediff.com/gnewssitemap.xml

Comments

  • http://www.rediff.com: robots.txt