bengalipanjika.com
robots.txt
Robots Exclusion Standard data for bengalipanjika.com
Resource Scan
Scan Details
| Site Domain | bengalipanjika.com |
| Base Domain | bengalipanjika.com |
| Scan Status | Ok |
| Last Scan | 2025-07-23T21:42:20+00:00 |
| Next Scan | 2025-07-30T21:42:20+00:00 |
Last Scan
| Scanned | 2025-07-23T21:42:20+00:00 |
| URL | https://bengalipanjika.com/robots.txt |
| Domain IPs | 104.21.30.125, 172.67.172.234, 2606:4700:3030::ac43:acea, 2606:4700:3033::6815:1e7d |
| Response IP | 172.67.172.234 |
| Found | Yes |
| Hash | 97b7882ea0ac5c9a8f07d819572efc0ed3d843d408433a54e613f47acc57d040 |
| SimHash | 6f11d155e7d1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /about/ |
| Disallow | /about-us/ |
| Disallow | /contact/ |
| Disallow | /contact-us/ |
| Disallow | /disclaimer/ |
| Disallow | /policy/ |
| Disallow | /privacy-policy/ |
| Disallow | /terms/ |
| Disallow | /terms-and-conditions/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bengalipanjika.com/sitemap.xml |