bengali.abplive.com
robots.txt
Robots Exclusion Standard data for bengali.abplive.com
Resource Scan
Scan Details
| Site Domain | bengali.abplive.com |
| Base Domain | abplive.com |
| Scan Status | Ok |
| Last Scan | 2024-05-16T22:17:03+00:00 |
| Next Scan | 2024-05-23T22:17:03+00:00 |
Last Scan
| Scanned | 2024-05-16T22:17:03+00:00 |
| URL | https://bengali.abplive.com/robots.txt |
| Domain IPs | 23.211.140.139 |
| Response IP | 96.17.72.51 |
| Found | Yes |
| Hash | 39481c7b293d0a38b0f871235757e7033f8e7c9f288e52f0ce5988d65d05fe28 |
| SimHash | ca1c5dc1d513 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /wp-admin/ |
| Disallow | /search?s* |
| Disallow | /search/page-* |
| Disallow | /abp-widget/ |
| Disallow | /adsunits/ |
| Disallow | /adsunits-a/ |
| Disallow | /adsunits-b/ |
| Disallow | /adsunits-c/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bengali.abplive.com/news-sitemap.xml |
| sitemap | https://bengali.abplive.com/video-sitemap.xml |
| sitemap | https://bengali.abplive.com/gallery-sitemap.xml |
| sitemap | https://bengali.abplive.com/google-news-sitemap.xml |
| sitemap | https://bengali.abplive.com/web-sitemap.xml |
| sitemap | https://bengali.abplive.com/amp-stories-sitemap.xml |
| sitemap | https://bengali.abplive.com/shortvideo-sitemap.xml |
Comments