udf.edu.br
robots.txt
Robots Exclusion Standard data for udf.edu.br
Resource Scan
Scan Details
| Site Domain | udf.edu.br |
| Base Domain | udf.edu.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-18T02:43:33+00:00 |
| Next Scan | 2024-07-02T02:43:33+00:00 |
Last Successful Scan
| Scanned | 2024-05-11T01:54:21+00:00 |
| URL | https://udf.edu.br/robots.txt |
| Redirect | https://www.udf.edu.br//robots.txt |
| Redirect Domain | www.udf.edu.br |
| Redirect Base | udf.edu.br |
| Domain IPs | 23.209.46.81, 23.209.46.88, 2600:1413:b000:1e::17d1:2e51, 2600:1413:b000:1e::17d1:2e58 |
| Redirect IPs | 23.209.46.71, 23.209.46.85, 2600:1413:b000:1f::17d1:2e18, 2600:1413:b000:1f::17d1:2e1f |
| Response IP | 184.27.123.33 |
| Found | Yes |
| Hash | e6603f4d92a9d45beb695f5e02b9464e3fa99e81db248dbbb469a2ecc3279f15 |
| SimHash | 0914d1351713 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search/* |
| Disallow | /generica |
| Disallow | /pagina-nao-encontrada |
| Disallow | /teste-cpa |
| Disallow | /pdp-extensao |
| Disallow | /pdp-pos-graduacao |
| Disallow | /sala-de-imprensa/detalhe-release |
| Disallow | /pdp |
| Disallow | /dados-gerais |
| Disallow | /modulos |
| Disallow | /robo |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.udf.edu.br/sitemap_index.xml |