bengali.pratilipi.com
robots.txt
Robots Exclusion Standard data for bengali.pratilipi.com
Resource Scan
Scan Details
| Site Domain | bengali.pratilipi.com |
| Base Domain | pratilipi.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-18T03:02:56+00:00 |
| Next Scan | 2024-10-16T03:02:56+00:00 |
Last Successful Scan
| Scanned | 2023-12-21T17:23:16+00:00 |
| URL | https://bengali.pratilipi.com/robots.txt |
| Domain IPs | 2600:9000:20c7:1a00:1b:eb26:cd80:93a1, 2600:9000:20c7:5e00:1b:eb26:cd80:93a1, 2600:9000:20c7:6000:1b:eb26:cd80:93a1, 2600:9000:20c7:9600:1b:eb26:cd80:93a1, 2600:9000:20c7:9800:1b:eb26:cd80:93a1, 2600:9000:20c7:b200:1b:eb26:cd80:93a1, 2600:9000:20c7:be00:1b:eb26:cd80:93a1, 2600:9000:20c7:fc00:1b:eb26:cd80:93a1, 52.84.251.118, 52.84.251.122, 52.84.251.42, 52.84.251.9 |
| Response IP | 143.204.9.37 |
| Found | Yes |
| Hash | 09840daf862ff660e5b34311c5c5dbfcd20d1f25df201b92e0da7011c75891d0 |
| SimHash | 3d10c936cb30 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /login |
| Disallow | /signup |
| Disallow | /reset-password |
| Disallow | /forgot-password |
| Disallow | /followers |
| Disallow | /following |
| Disallow | /library |
| Disallow | /notifications/ |
| Disallow | /settings/ |
| Disallow | /user/ |
| Disallow | /read/ |
| Disallow | /read?* |
| Disallow | /collections/ |
| Allow | /.well-known/assetlinks.json |