varthabharati.in
robots.txt
Robots Exclusion Standard data for varthabharati.in
Resource Scan
Scan Details
| Site Domain | varthabharati.in |
| Base Domain | varthabharati.in |
| Scan Status | Ok |
| Last Scan | 2024-05-24T10:33:35+00:00 |
| Next Scan | 2024-05-31T10:33:35+00:00 |
Last Scan
| Scanned | 2024-05-24T10:33:35+00:00 |
| URL | https://varthabharati.in/robots.txt |
| Redirect | https://www.varthabharati.in/robots.txt |
| Redirect Domain | www.varthabharati.in |
| Redirect Base | varthabharati.in |
| Domain IPs | 216.48.185.30 |
| Redirect IPs | 13.225.4.102, 13.225.4.17, 13.225.4.34, 13.225.4.9, 2600:9000:21b4:200:1b:a55:cb40:93a1, 2600:9000:21b4:5c00:1b:a55:cb40:93a1, 2600:9000:21b4:a00:1b:a55:cb40:93a1, 2600:9000:21b4:be00:1b:a55:cb40:93a1, 2600:9000:21b4:c00:1b:a55:cb40:93a1, 2600:9000:21b4:f200:1b:a55:cb40:93a1, 2600:9000:21b4:fa00:1b:a55:cb40:93a1, 2600:9000:21b4:fe00:1b:a55:cb40:93a1 |
| Response IP | 13.225.4.9 |
| Found | Yes |
| Hash | 27930cd5cfe1a25bceba9ae393c6ff76347c6b041b57787d8165110a75695791 |
| SimHash | c3425e57cdc7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/* |
| Disallow | /search/* |
| Disallow | /search?* |
| Disallow | /xhr/* |
| Disallow | /preview/story-* |
| Disallow | /amp/preview/story-* |
| Disallow | /staging/* |
| Disallow | /alfoo |
| Disallow | /sildoo |
| Disallow | /dutas |
| Disallow | /metsmall |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.varthabharati.in/sitemap/sitemap-index.xml |
| sitemap | https://www.varthabharati.in/news-sitemap-daily.xml |
| sitemap | https://www.varthabharati.in/feeds.xml |
| sitemap | https://www.varthabharati.in/sitemap-daily.xml |
Comments