hindi.mid-day.com
robots.txt

Robots Exclusion Standard data for hindi.mid-day.com

Resource Scan

Scan Details

Site Domain hindi.mid-day.com
Base Domain mid-day.com
Scan Status Ok
Last Scan3/22/2025, 2:35:27 AM
Next Scan 4/21/2025, 2:35:27 AM

Last Scan

Scanned3/22/2025, 2:35:27 AM
URL https://hindi.mid-day.com/robots.txt
Domain IPs 23.52.171.120, 23.52.171.160, 2600:1413:b000:13::b857:c18c, 2600:1413:b000:13::b857:c194
Response IP 23.49.60.59
Found Yes
Hash eaad819abdadf0672f1132ef0d156ad8172612adba37ac37b015b4f9223d4dc8
SimHash dc10dc038f13

Groups

*

Rule Path
Allow /
Disallow /search/

Other Records

Field Value
sitemap https://hindi.mid-day.com/Resources/rss/mumbai-sitemap.xml
sitemap https://hindi.mid-day.com/Resources/rss/news-sitemap.xml
sitemap https://hindi.mid-day.com/Resources/rss/entertainment-sitemap.xml
sitemap https://hindi.mid-day.com/Resources/rss/lifestyle-sitemap.xml
sitemap https://hindi.mid-day.com/Resources/rss/sports-sitemap.xml

Warnings

  • 2 invalid lines.