bhaskarhindi.com
robots.txt

Robots Exclusion Standard data for bhaskarhindi.com

Resource Scan

Scan Details

Site Domain bhaskarhindi.com
Base Domain bhaskarhindi.com
Scan Status Ok
Last Scan2024-06-23T02:49:20+00:00
Next Scan 2024-06-30T02:49:20+00:00

Last Scan

Scanned2024-06-23T02:49:20+00:00
URL https://bhaskarhindi.com/robots.txt
Redirect https://www.bhaskarhindi.com/robots.txt
Redirect Domain www.bhaskarhindi.com
Redirect Base bhaskarhindi.com
Domain IPs 164.52.221.36
Redirect IPs 13.33.30.101, 13.33.30.63, 13.33.30.77, 13.33.30.96, 2600:9000:229f:3c00:18:27e4:dec0:93a1, 2600:9000:229f:3e00:18:27e4:dec0:93a1, 2600:9000:229f:4a00:18:27e4:dec0:93a1, 2600:9000:229f:5a00:18:27e4:dec0:93a1, 2600:9000:229f:5c00:18:27e4:dec0:93a1, 2600:9000:229f:7400:18:27e4:dec0:93a1, 2600:9000:229f:da00:18:27e4:dec0:93a1, 2600:9000:229f:fc00:18:27e4:dec0:93a1
Response IP 13.33.30.63
Found Yes
Hash fa4ea1de605015d702fb04b961ac4d22e96aac31732325cdaa3079d0fe32c721
SimHash c01138570f93

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /breaking-ticker-articles/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Disallow /bulletin/*
Disallow /cartoons/*
Disallow /tags/?%3F%3F
Disallow /weekly-items
Disallow /daily-items
Disallow /bulletin
Disallow /pdf_upload/1640358657509219522021-406708.pdf
Disallow /xhr/getNewsMixin*
Disallow /h-ajax-request/*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.bhaskarhindi.com/sitemap/sitemap-index.xml
sitemap https://www.bhaskarhindi.com/news-sitemap-daily.xml
sitemap https://www.bhaskarhindi.com/feeds.xml

Comments

  • robots.txt for https://www.bhaskarhindi.com/