appsforgood.org
robots.txt
Robots Exclusion Standard data for appsforgood.org
Resource Scan
Scan Details
Site Domain | appsforgood.org |
Base Domain | appsforgood.org |
Scan Status | Ok |
Last Scan | 2025-09-14T19:08:04+00:00 |
Next Scan | 2025-10-14T19:08:04+00:00 |
Last Scan
Scanned | 2025-09-14T19:08:04+00:00 |
URL | https://appsforgood.org/robots.txt |
Redirect | https://www.appsforgood.org/robots.txt |
Redirect Domain | www.appsforgood.org |
Redirect Base | appsforgood.org |
Domain IPs | 217.70.184.55 |
Redirect IPs | 15.197.129.158, 75.2.43.161, 76.223.11.49, 99.83.217.1 |
Response IP | 15.197.129.158 |
Found | Yes |
Hash | dbbfc80dc29b265b96c89a20812210d1e37f4966853f8a4904219f7f127d8c45 |
SimHash | 6340d455d115 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://afg-sitemaps.s3.eu-west-2.amazonaws.com/sitemap-production.xml.gz |