globalgiving.org
robots.txt
Robots Exclusion Standard data for globalgiving.org
Resource Scan
Scan Details
| Site Domain | globalgiving.org |
| Base Domain | globalgiving.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-04T14:57:24+00:00 |
| Next Scan | 2024-12-03T14:57:24+00:00 |
Last Successful Scan
| Scanned | 2024-01-16T14:55:29+00:00 |
| URL | https://www.globalgiving.org/robots.txt |
| Domain IPs | 2600:9000:2640:3a00:19:95cb:500:93a1, 2600:9000:2640:4200:19:95cb:500:93a1, 2600:9000:2640:7600:19:95cb:500:93a1, 2600:9000:2640:8e00:19:95cb:500:93a1, 2600:9000:2640:9800:19:95cb:500:93a1, 2600:9000:2640:a800:19:95cb:500:93a1, 2600:9000:2640:e200:19:95cb:500:93a1, 2600:9000:2640:f200:19:95cb:500:93a1, 99.86.178.105, 99.86.178.35, 99.86.178.4, 99.86.178.72 |
| Response IP | 108.138.189.56 |
| Found | Yes |
| Hash | b7f994b4ccf926ec3f373ec5db1e288022b3bfd8c72291d84d235b26af71e9f2 |
| SimHash | b8114ac54c9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dy/v2/checkout/ |
| Disallow | /dy/cart/ |
| Disallow | /projects/*/pelinks* |
| Disallow | /funds/*/pelinks* |
| Disallow | /microprojects/projects/*/pelinks* |
| Disallow | /dy/v2/pe/* |
| Disallow | /si/ |
| Disallow | *-test |
Other Records
| Field | Value |
|---|---|
| sitemap | https://assets.globalgiving.org/sitemap/sitemap.xml.gz |