agriaffaires.com.br
robots.txt
Robots Exclusion Standard data for agriaffaires.com.br
Resource Scan
Scan Details
| Site Domain | agriaffaires.com.br |
| Base Domain | agriaffaires.com.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-01T17:49:45+00:00 |
| Next Scan | 2024-11-15T17:49:45+00:00 |
Last Successful Scan
| Scanned | 2022-11-19T17:05:51+00:00 |
| URL | https://www.agriaffaires.com.br/robots.txt |
| Response IP | 18.155.68.114, 18.155.68.74, 18.155.68.39, 18.155.68.49 |
| Found | Yes |
| Hash | 730e403df346e0550f9baeceb4ec7fef865530266226c793f5c9ef596cf7afbe |
| SimHash | b90095385d53 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /conta/ |
| Disallow | /*resultados |
| Disallow | /seleccao/ |
| Disallow | /*? |
| Disallow | /myaccount/ |
| Disallow | /aluguer/ |
| Disallow | /response/ |
| Disallow | /remove-filter/ |
| Disallow | /pdf-avaliacao/ |
| Disallow | /procura/ |
| Disallow | /geo/ |
| Disallow | /list/change-site |
| Disallow | /classified/redirect/ |
| Disallow | /redcard/ |
| Disallow | /expertise/nouvelle* |
| Disallow | /observatoire-prix/check/* |
| Disallow | /guide/ |
| Allow | /servico/npro/transport.html |
Comments