care.org.au
robots.txt
Robots Exclusion Standard data for care.org.au
Resource Scan
Scan Details
| Site Domain | care.org.au |
| Base Domain | care.org.au |
| Scan Status | Ok |
| Last Scan | 2024-05-24T10:21:26+00:00 |
| Next Scan | 2024-06-23T10:21:26+00:00 |
Last Scan
| Scanned | 2024-05-24T10:21:26+00:00 |
| URL | https://care.org.au/robots.txt |
| Redirect | https://www.care.org.au/robots.txt |
| Redirect Domain | www.care.org.au |
| Redirect Base | care.org.au |
| Domain IPs | 3.81.178.115, 3.82.81.201 |
| Redirect IPs | 18.155.68.3, 18.155.68.68, 18.155.68.85, 18.155.68.97, 2600:9000:23d2:1c00:4:2bc4:2780:93a1, 2600:9000:23d2:4600:4:2bc4:2780:93a1, 2600:9000:23d2:5e00:4:2bc4:2780:93a1, 2600:9000:23d2:600:4:2bc4:2780:93a1, 2600:9000:23d2:9800:4:2bc4:2780:93a1, 2600:9000:23d2:9e00:4:2bc4:2780:93a1, 2600:9000:23d2:ce00:4:2bc4:2780:93a1, 2600:9000:23d2:f200:4:2bc4:2780:93a1 |
| Response IP | 18.155.68.3 |
| Found | Yes |
| Hash | 6ae556e7da0ce7ec6d19dc71ad4007de7a7239122d302c7c64c26aa23e967f90 |
| SimHash | 431518c98f92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | /?s=* |
| Disallow | /tag/ |
| Disallow | /sector_cat/ |
| Disallow | /blog/page/ |
| Disallow | /media_release_tag/ |
| Disallow | /country_cat/ |
| Disallow | /appeal_cat/ |
| Disallow | /category/blog |
| Disallow | /category/news |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.care.org.au/sitemap_index.xml |