benbangla.com
robots.txt
Robots Exclusion Standard data for benbangla.com
Resource Scan
Scan Details
| Site Domain | benbangla.com |
| Base Domain | benbangla.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-24T20:44:42+00:00 |
| Next Scan | 2024-11-22T20:44:42+00:00 |
Last Successful Scan
| Scanned | 2023-05-03T19:14:57+00:00 |
| URL | https://benbangla.com/robots.txt |
| Domain IPs | 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30 |
| Response IP | 13.250.129.152 |
| Found | Yes |
| Hash | e6459c6a07121daea752553856135916117863076383ed95e8dc8f3c42578f12 |
| SimHash | 6d31e909d572 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /plugins/ |
| Disallow | /tag/ |
| Disallow | /author/ |
| Disallow | /themes/ |
| Disallow | /registration/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.benbangla.com/sitemap_index.xml |