care.org.au
robots.txt
Robots Exclusion Standard data for care.org.au
Resource Scan
Scan Details
| Site Domain | care.org.au |
| Base Domain | care.org.au |
| Scan Status | Ok |
| Last Scan | 2024-09-21T10:22:27+00:00 |
| Next Scan | 2024-10-21T10:22:27+00:00 |
Last Scan
| Scanned | 2024-09-21T10:22:27+00:00 |
| URL | https://care.org.au/robots.txt |
| Redirect | https://www.care.org.au/robots.txt |
| Redirect Domain | www.care.org.au |
| Redirect Base | care.org.au |
| Domain IPs | 3.81.178.115, 3.82.81.201 |
| Redirect IPs | 18.155.68.3, 18.155.68.68, 18.155.68.85, 18.155.68.97, 2600:9000:23d2:1200:4:2bc4:2780:93a1, 2600:9000:23d2:5600:4:2bc4:2780:93a1, 2600:9000:23d2:7e00:4:2bc4:2780:93a1, 2600:9000:23d2:800:4:2bc4:2780:93a1, 2600:9000:23d2:9000:4:2bc4:2780:93a1, 2600:9000:23d2:a800:4:2bc4:2780:93a1, 2600:9000:23d2:d200:4:2bc4:2780:93a1, 2600:9000:23d2:dc00:4:2bc4:2780:93a1 |
| Response IP | 18.155.68.68 |
| Found | Yes |
| Hash | 6ae556e7da0ce7ec6d19dc71ad4007de7a7239122d302c7c64c26aa23e967f90 |
| SimHash | 431518c98f92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | /?s=* |
| Disallow | /tag/ |
| Disallow | /sector_cat/ |
| Disallow | /blog/page/ |
| Disallow | /media_release_tag/ |
| Disallow | /country_cat/ |
| Disallow | /appeal_cat/ |
| Disallow | /category/blog |
| Disallow | /category/news |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.care.org.au/sitemap_index.xml |