ratemyagent.com
robots.txt
Robots Exclusion Standard data for ratemyagent.com
Resource Scan
Scan Details
| Site Domain | ratemyagent.com |
| Base Domain | ratemyagent.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T05:34:49+00:00 |
| Next Scan | 2024-12-14T05:34:49+00:00 |
Last Scan
| Scanned | 2024-11-14T05:34:49+00:00 |
| URL | https://ratemyagent.com/robots.txt |
| Redirect | https://www.ratemyagent.com:443/robots.txt |
| Redirect Domain | www.ratemyagent.com |
| Redirect Base | ratemyagent.com |
| Domain IPs | 13.35.210.14, 13.35.210.35, 13.35.210.66, 13.35.210.95 |
| Redirect IPs | 13.35.210.14, 13.35.210.35, 13.35.210.66, 13.35.210.95, 2600:9000:2078:2a00:f:84e2:7500:93a1, 2600:9000:2078:3200:f:84e2:7500:93a1, 2600:9000:2078:3a00:f:84e2:7500:93a1, 2600:9000:2078:5c00:f:84e2:7500:93a1, 2600:9000:2078:5e00:f:84e2:7500:93a1, 2600:9000:2078:8c00:f:84e2:7500:93a1, 2600:9000:2078:c800:f:84e2:7500:93a1, 2600:9000:2078:de00:f:84e2:7500:93a1 |
| Response IP | 13.35.210.35 |
| Found | Yes |
| Hash | 12a9b9f0b35191af2cd26475230a78ad3131d265a043ca0b799d55de253c8062 |
| SimHash | 6b015852ed00 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /error/ |
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /dashboard/ |
| Disallow | /promoter/ |
| Disallow | /account |
| Disallow | /agency/ |
| Disallow | /agent/ |
| Disallow | /suburb/search/ |
| Disallow | /testimonial/ |
| Disallow | /arkadia |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ratemyagent.com/sitemap.xml |
Comments