http-aws.greatergood.com
robots.txt
Robots Exclusion Standard data for http-aws.greatergood.com
Resource Scan
Scan Details
| Site Domain | http-aws.greatergood.com |
| Base Domain | greatergood.com |
| Scan Status | Ok |
| Last Scan | 2024-06-17T19:59:53+00:00 |
| Next Scan | 2024-07-17T19:59:53+00:00 |
Last Scan
| Scanned | 2024-06-17T19:59:53+00:00 |
| URL | https://http-aws.greatergood.com/robots.txt |
| Domain IPs | 104.18.24.221, 104.18.25.221, 2606:4700::6812:18dd, 2606:4700::6812:19dd |
| Response IP | 104.18.24.221 |
| Found | Yes |
| Hash | 748276da0098f207919ef947669e313bc7fe44a037ea8628ad023e01b0ec24c7 |
| SimHash | 0a989ac3c308 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /clicktogive/ad.click |
| Disallow | /clicktogive/*/registration |
| Disallow | /clicktogive/*/story-submit/ |
| Disallow | /clicktogive/*/subscriptions |
| Disallow | /clicktogive/*/take-action-subscriptions |
| Disallow | /clicktogive/artisans.faces |
| Disallow | /clicktogive/campaign.faces |
| Disallow | /clicktogive/gamesthatgive.faces |
| Disallow | /manage |
| Disallow | /unsubscribe |
| Disallow | /store/*/adpage |
| Disallow | /store/*/newsletter |
| Disallow | /store/*/productemail |
| Disallow | /store/*/shoppingcart |
| Disallow | /store/*/address |
| Disallow | /store/*/payment |
| Disallow | /store/*/thankyou |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
applebot
| Rule | Path |
|---|---|
| Disallow | /clicktogive/ad.click |
| Disallow | /clicktogive/*/registration |
| Disallow | /clicktogive/*/story-submit/ |
| Disallow | /clicktogive/*/subscriptions |
| Disallow | /clicktogive/*/take-action-subscriptions |
| Disallow | /clicktogive/artisans.faces |
| Disallow | /clicktogive/campaign.faces |
| Disallow | /clicktogive/gamesthatgive.faces |
| Disallow | /manage |
| Disallow | /unsubscribe |
| Disallow | /store/*/adpage |
| Disallow | /store/*/newsletter |
| Disallow | /store/*/productemail |
| Disallow | /store/*/shoppingcart |
| Disallow | /store/*/address |
| Disallow | /store/*/payment |
| Disallow | /store/*/thankyou |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |