ratemyagent.com.au
robots.txt
Robots Exclusion Standard data for ratemyagent.com.au
Resource Scan
Scan Details
| Site Domain | ratemyagent.com.au |
| Base Domain | ratemyagent.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-15T06:53:33+00:00 |
| Next Scan | 2024-10-15T06:53:33+00:00 |
Last Scan
| Scanned | 2024-09-15T06:53:33+00:00 |
| URL | https://ratemyagent.com.au/robots.txt |
| Redirect | https://www.ratemyagent.com.au:443/robots.txt |
| Redirect Domain | www.ratemyagent.com.au |
| Redirect Base | ratemyagent.com.au |
| Domain IPs | 13.225.4.23, 13.225.4.34, 13.225.4.51, 13.225.4.82 |
| Redirect IPs | 13.225.4.23, 13.225.4.34, 13.225.4.51, 13.225.4.82, 2600:9000:21b4:1600:e:93e6:dc0:93a1, 2600:9000:21b4:2400:e:93e6:dc0:93a1, 2600:9000:21b4:4000:e:93e6:dc0:93a1, 2600:9000:21b4:4a00:e:93e6:dc0:93a1, 2600:9000:21b4:5000:e:93e6:dc0:93a1, 2600:9000:21b4:5c00:e:93e6:dc0:93a1, 2600:9000:21b4:5e00:e:93e6:dc0:93a1, 2600:9000:21b4:d600:e:93e6:dc0:93a1 |
| Response IP | 13.225.4.82 |
| Found | Yes |
| Hash | a7d4e2170e6bf2acba476394165bb62200487bddb03dc0d8b190e241c64ab155 |
| SimHash | 6b0950d2ed00 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /error/ |
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /dashboard/ |
| Disallow | /promoter/ |
| Disallow | /account |
| Disallow | /agency/ |
| Disallow | /agent/ |
| Disallow | /suburb/search/ |
| Disallow | /testimonial/ |
| Disallow | /arkadia |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ratemyagent.com.au/sitemap.xml |
Comments