bengali.timesnownews.com
robots.txt
Robots Exclusion Standard data for bengali.timesnownews.com
Resource Scan
Scan Details
| Site Domain | bengali.timesnownews.com |
| Base Domain | timesnownews.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T15:38:53+00:00 |
| Next Scan | 2024-11-10T15:38:53+00:00 |
Last Scan
| Scanned | 2024-11-03T15:38:53+00:00 |
| URL | https://bengali.timesnownews.com/robots.txt |
| Domain IPs | 2600:1413:b000:1c::17d1:2ed1, 2600:1413:b000:1c::17d1:2ed2, 96.17.180.131, 96.17.180.185 |
| Response IP | 96.17.180.185 |
| Found | Yes |
| Hash | d86381a67befa35fb36f3c4cb6c57e648feb09a26db6c9acf43fa141361cdc88 |
| SimHash | 454151d4c07a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wapi/ |
| Disallow | /?nbck=1 |
| Disallow | /?nexthome=1 |
| Disallow | /presite |
| Disallow | /story/* |
| Disallow | /test-section/ |
| Disallow | /embed/ |
| Disallow | /search-result/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bengali.timesnownews.com/feeds/google-news-sitemap-bn.xml |
| sitemap | https://bengali.timesnownews.com/feeds/bn-yesterday-sitemap.xml |
| sitemap | https://bengali.timesnownews.com/feeds/bn-today-sitemap.xml |
Comments