goto.gg
robots.txt
Robots Exclusion Standard data for goto.gg
Resource Scan
Scan Details
Site Domain | goto.gg |
Base Domain | goto.gg |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-18T00:29:36+00:00 |
Next Scan | 2024-10-16T00:29:36+00:00 |
Last Successful Scan
Scanned | 2024-02-26T10:43:32+00:00 |
URL | https://goto.gg/robots.txt |
Redirect | https://www.globalgiving.org/robots.txt |
Redirect Domain | www.globalgiving.org |
Redirect Base | globalgiving.org |
Domain IPs | 13.227.254.111, 13.227.254.3, 13.227.254.71, 13.227.254.74 |
Redirect IPs | 2600:9000:20c7:2400:19:95cb:500:93a1, 2600:9000:20c7:2e00:19:95cb:500:93a1, 2600:9000:20c7:4800:19:95cb:500:93a1, 2600:9000:20c7:6000:19:95cb:500:93a1, 2600:9000:20c7:8c00:19:95cb:500:93a1, 2600:9000:20c7:9400:19:95cb:500:93a1, 2600:9000:20c7:9c00:19:95cb:500:93a1, 2600:9000:20c7:c00:19:95cb:500:93a1, 52.84.251.107, 52.84.251.47, 52.84.251.61, 52.84.251.68 |
Response IP | 52.84.251.107 |
Found | Yes |
Hash | b7f994b4ccf926ec3f373ec5db1e288022b3bfd8c72291d84d235b26af71e9f2 |
SimHash | b8114ac54c9a |
Groups
*
Rule | Path |
---|---|
Disallow | /dy/v2/checkout/ |
Disallow | /dy/cart/ |
Disallow | /projects/*/pelinks* |
Disallow | /funds/*/pelinks* |
Disallow | /microprojects/projects/*/pelinks* |
Disallow | /dy/v2/pe/* |
Disallow | /si/ |
Disallow | *-test |
Other Records
Field | Value |
---|---|
sitemap | https://assets.globalgiving.org/sitemap/sitemap.xml.gz |