consumersadvocate.org
robots.txt
Robots Exclusion Standard data for consumersadvocate.org
Resource Scan
Scan Details
| Site Domain | consumersadvocate.org |
| Base Domain | consumersadvocate.org |
| Scan Status | Ok |
| Last Scan | 2025-03-09T21:58:57+00:00 |
| Next Scan | 2025-04-08T21:58:57+00:00 |
Last Scan
| Scanned | 2025-03-09T21:58:57+00:00 |
| URL | https://consumersadvocate.org/robots.txt |
| Redirect | https://www.consumersadvocate.org/robots.txt |
| Redirect Domain | www.consumersadvocate.org |
| Redirect Base | consumersadvocate.org |
| Domain IPs | 104.26.0.110, 104.26.1.110, 172.67.74.137 |
| Redirect IPs | 104.26.0.110, 104.26.1.110, 172.67.74.137 |
| Response IP | 104.26.0.110 |
| Found | Yes |
| Hash | 0170a3ba7b6ea37e488a1f2d66f0b9db5421be9d57f0fbbbfb6e8119eb2e352d |
| SimHash | 29017d934f34 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /401 |
| Disallow | /403 |
| Disallow | /404 |
| Disallow | /422 |
| Disallow | /500 |
| Disallow | /offline.html |
| Disallow | /error.html |
| Disallow | /cdn-cgi/ |
| Disallow | /r/ |
| Disallow | /p/ |
| Disallow | /pr/ |
| Disallow | /go/ |
| Disallow | /oauth/ |
| Disallow | /data/ |
| Disallow | /users/settings |
| Disallow | /users/auth |
| Disallow | /users/sign_up |
| Disallow | /users/sign_in |
| Disallow | /users/sign_out |
| Disallow | /users/password |
| Disallow | /users/confirmation |
| Disallow | /company_admin |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.consumersadvocate.org/system/sitemap.xml.gz |