dr-tony-mander.com.au
robots.txt
Robots Exclusion Standard data for dr-tony-mander.com.au
Resource Scan
Scan Details
| Site Domain | dr-tony-mander.com.au |
| Base Domain | dr-tony-mander.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-16T15:56:58+00:00 |
| Next Scan | 2024-11-15T15:56:58+00:00 |
Last Successful Scan
| Scanned | 2024-07-12T15:56:09+00:00 |
| URL | https://dr-tony-mander.com.au/robots.txt |
| Redirect | https://www.dr-tony-mander.com.au/robots.txt |
| Redirect Domain | www.dr-tony-mander.com.au |
| Redirect Base | dr-tony-mander.com.au |
| Domain IPs | 13.225.4.113, 13.225.4.12, 13.225.4.18, 13.225.4.21 |
| Redirect IPs | 13.225.4.113, 13.225.4.12, 13.225.4.18, 13.225.4.21 |
| Response IP | 13.225.4.12 |
| Found | Yes |
| Hash | ad6f1ddd50ca79840b5b1114ac5205a1ee8d8398a1cfc7734ee6ddc557556ffd |
| SimHash | 7909d8c0a38b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dash/ |
| Disallow | /pp* |
| Disallow | /trackback |
| Disallow | /cgi-bin |
| Disallow | /search |
| Disallow | /rss |
| Disallow | /comments/feed |
| Disallow | /*/trackback/$ |
| Disallow | /hero_slides |
| Disallow | /banners |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dr-tony-mander.com.au/sitemap.xml |