live.worldbank.org
robots.txt
Robots Exclusion Standard data for live.worldbank.org
Resource Scan
Scan Details
| Site Domain | live.worldbank.org |
| Base Domain | worldbank.org |
| Scan Status | Ok |
| Last Scan | 2024-05-22T12:40:18+00:00 |
| Next Scan | 2024-06-21T12:40:18+00:00 |
Last Scan
| Scanned | 2024-05-22T12:40:18+00:00 |
| URL | https://live.worldbank.org/robots.txt |
| Domain IPs | 13.33.30.10, 13.33.30.30, 13.33.30.8, 13.33.30.85, 2600:9000:229f:200:5:c8ec:5a40:93a1, 2600:9000:229f:3600:5:c8ec:5a40:93a1, 2600:9000:229f:3800:5:c8ec:5a40:93a1, 2600:9000:229f:800:5:c8ec:5a40:93a1, 2600:9000:229f:b000:5:c8ec:5a40:93a1, 2600:9000:229f:c000:5:c8ec:5a40:93a1, 2600:9000:229f:c600:5:c8ec:5a40:93a1, 2600:9000:229f:da00:5:c8ec:5a40:93a1 |
| Response IP | 13.33.30.8 |
| Found | Yes |
| Hash | 8e99cac3b6dcb96d5bc1c9e6a34e7b0ac78637fc1602063c048f37739443a9a2 |
| SimHash | 018c81d2cf96 |
Groups
*
| Rule | Path |
|---|---|
| Allow | * |
| Disallow | */apps/* |
| Disallow | */libs/* |
| Disallow | */bin/* |
| Disallow | */wbg/services/* |
| Disallow | */misc* |
| Disallow | */conf/* |
| Disallow | */wbg/aem/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://live.worldbank.org/sitemap.xml |