newstm.in
robots.txt
Robots Exclusion Standard data for newstm.in
Resource Scan
Scan Details
| Site Domain | newstm.in |
| Base Domain | newstm.in |
| Scan Status | Ok |
| Last Scan | 2024-05-29T19:44:15+00:00 |
| Next Scan | 2024-06-05T19:44:15+00:00 |
Last Scan
| Scanned | 2024-05-29T19:44:15+00:00 |
| URL | https://newstm.in/robots.txt |
| Domain IPs | 23.213.158.17, 23.213.158.9 |
| Response IP | 23.213.158.17 |
| Found | Yes |
| Hash | e38972050e969ce2cb0a52b12fae29e3dad298a07a84a1705f9f16cf9dcf20e3 |
| SimHash | 0901dc32c6f1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /preview?article |
*
| Rule | Path |
|---|---|
| Disallow | */can/evnt/click* |
*
| Rule | Path |
|---|---|
| Disallow | *?col_ci=* |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| sitemap | https://newstm.in/sitemap.xml |
| sitemap | https://newstm.in/news-sitemap.xml |
| sitemap | https://newstm.in/sitemap_index.xml |
| sitemap | https://newstm.in/category-sitemap.xml |
| sitemap | https://newstm.in/image-sitemap.xml |