care.org.au
robots.txt
Robots Exclusion Standard data for care.org.au
Resource Scan
Scan Details
| Site Domain | care.org.au |
| Base Domain | care.org.au |
| Scan Status | Ok |
| Last Scan | 2024-10-21T10:22:38+00:00 |
| Next Scan | 2024-11-20T10:22:38+00:00 |
Last Scan
| Scanned | 2024-10-21T10:22:38+00:00 |
| URL | https://care.org.au/robots.txt |
| Redirect | https://www.care.org.au/robots.txt |
| Redirect Domain | www.care.org.au |
| Redirect Base | care.org.au |
| Domain IPs | 3.81.178.115, 3.82.81.201 |
| Redirect IPs | 13.225.4.111, 13.225.4.128, 13.225.4.55, 13.225.4.7, 2600:9000:21b4:3e00:4:2bc4:2780:93a1, 2600:9000:21b4:4200:4:2bc4:2780:93a1, 2600:9000:21b4:4400:4:2bc4:2780:93a1, 2600:9000:21b4:5200:4:2bc4:2780:93a1, 2600:9000:21b4:5800:4:2bc4:2780:93a1, 2600:9000:21b4:9000:4:2bc4:2780:93a1, 2600:9000:21b4:9600:4:2bc4:2780:93a1, 2600:9000:21b4:e600:4:2bc4:2780:93a1 |
| Response IP | 13.225.4.128 |
| Found | Yes |
| Hash | 6ae556e7da0ce7ec6d19dc71ad4007de7a7239122d302c7c64c26aa23e967f90 |
| SimHash | 431518c98f92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | /?s=* |
| Disallow | /tag/ |
| Disallow | /sector_cat/ |
| Disallow | /blog/page/ |
| Disallow | /media_release_tag/ |
| Disallow | /country_cat/ |
| Disallow | /appeal_cat/ |
| Disallow | /category/blog |
| Disallow | /category/news |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.care.org.au/sitemap_index.xml |