givingassistant.org
robots.txt
Robots Exclusion Standard data for givingassistant.org
Resource Scan
Scan Details
| Site Domain | givingassistant.org |
| Base Domain | givingassistant.org |
| Scan Status | Ok |
| Last Scan | 2024-11-16T05:38:39+00:00 |
| Next Scan | 2024-11-23T05:38:39+00:00 |
Last Scan
| Scanned | 2024-11-16T05:38:39+00:00 |
| URL | https://givingassistant.org/robots.txt |
| Domain IPs | 104.26.12.59, 104.26.13.59, 172.67.68.112, 2606:4700:20::681a:c3b, 2606:4700:20::681a:d3b, 2606:4700:20::ac43:4470 |
| Response IP | 104.26.12.59 |
| Found | Yes |
| Hash | 6d134098f7691cb2a6f0a388442172a89b78339304f00649b08bf12ae1aeda21 |
| SimHash | 6501be257f92 |
Groups
*
gptbot disallow: /
| Rule | Path |
|---|---|
| Disallow | /noaccess |
| Disallow | /account |
| Disallow | /cgi-bin/ |
| Disallow | /cache/ |
| Disallow | /frame/ |
| Disallow | /out/ |
| Disallow | /m/ |
| Disallow | /deals/ |
| Disallow | /store/ |
| Disallow | /_next/ |
| Disallow | /product/ |
| Disallow | /health.php |
| Disallow | /search?=* |
| Disallow | /search?q=* |
| Disallow | /?rid |
| Disallow | /?utm_source |
| Disallow | /?u |
| Disallow | /?sign-in |
| Disallow | /?join |
| Disallow | /?v1 |
| Disallow | /?utm_campaign |
| Disallow | /?tag |
| Disallow | /?utm_medium |
| Disallow | /?ts |
| Disallow | /?outid |
| Disallow | /?utm_content |
| Disallow | /?join%2F1000 |
| Disallow | /?ut |
| Disallow | /?join&utm_source |
| Disallow | /?fbclid |
| Disallow | /?utm_campaig |
| Disallow | /?utm_camp |
| Disallow | /mobile/ |
| Disallow | /coupons/user/* |
| Disallow | /coupons/storelink/* |
| Disallow | /credit-cards/* |
| Disallow | /partners/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://givingassistant.org/sitemap/index.xml |
| sitemap | https://givingassistant.org/sitemap/pages.xml |
| sitemap | https://givingassistant.org/sitemap/stores.xml |
| sitemap | https://givingassistant.org/sitemap/categories.xml |
Warnings
- 1 invalid line.