maxmaharashtra.com
robots.txt

Robots Exclusion Standard data for maxmaharashtra.com

Resource Scan

Scan Details

Site Domain maxmaharashtra.com
Base Domain maxmaharashtra.com
Scan Status Ok
Last Scan2024-11-11T12:38:09+00:00
Next Scan 2024-11-18T12:38:09+00:00

Last Scan

Scanned2024-11-11T12:38:09+00:00
URL https://maxmaharashtra.com/robots.txt
Redirect https://www.maxmaharashtra.com/robots.txt
Redirect Domain www.maxmaharashtra.com
Redirect Base maxmaharashtra.com
Domain IPs 104.21.21.252, 172.67.201.166, 2606:4700:3032::6815:15fc, 2606:4700:3036::ac43:c9a6
Redirect IPs 104.21.21.252, 172.67.201.166, 2606:4700:3032::6815:15fc, 2606:4700:3036::ac43:c9a6
Response IP 104.21.21.252
Found Yes
Hash 6684ad4d276c51cecd8f4b24589bee6222fb4b9fd78d8400beac8c78825195d9
SimHash 825a1e574d87

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Disallow /news-update/minister-yashomati-thakur-and-mla-sanjay-kute-tussle-in-assembly-over-central-kitchen-food-supply-contact-803077
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.maxmaharashtra.com/sitemap/sitemap-index.xml
sitemap https://www.maxmaharashtra.com/news-sitemap-daily.xml
sitemap https://www.maxmaharashtra.com/feeds.xml

Comments

  • robots.txt for https://www.maxmaharashtra.com/