petrescue.com.au
robots.txt
Robots Exclusion Standard data for petrescue.com.au
Resource Scan
Scan Details
| Site Domain | petrescue.com.au |
| Base Domain | petrescue.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-14T13:31:32+00:00 |
| Next Scan | 2024-09-21T13:31:32+00:00 |
Last Scan
| Scanned | 2024-09-14T13:31:32+00:00 |
| URL | https://petrescue.com.au/robots.txt |
| Redirect | https://www.petrescue.com.au/robots.txt |
| Redirect Domain | www.petrescue.com.au |
| Redirect Base | petrescue.com.au |
| Domain IPs | 13.55.131.47, 54.66.255.24 |
| Redirect IPs | 13.55.131.47, 54.66.255.24 |
| Response IP | 13.55.131.47 |
| Found | Yes |
| Hash | 1cb2bbdbf88a35c2c21d369f1bbbec954d036237a5f31955d620f939e73f27df |
| SimHash | b18d298d0154 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /library/articles/a-message-from-petrescue |
| Disallow | /library/articles/a-message-from-our-co-founder |
| Disallow | /library/articles/get-the-facts |
| Disallow | /library/articles/icon-credits |
| Disallow | /api/v1 |
| Disallow | /api/v2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.petrescue.com.au/sitemaps.xml |
Warnings
- `noindex` is not a known field.
Comments