ufgd.edu.br
robots.txt

Robots Exclusion Standard data for ufgd.edu.br

Resource Scan

Scan Details

Site Domain ufgd.edu.br
Base Domain ufgd.edu.br
Scan Status Ok
Last Scan2026-02-04T21:03:22+00:00
Next Scan 2026-03-06T21:03:22+00:00

Last Scan

Scanned2026-02-04T21:03:22+00:00
URL https://ufgd.edu.br/robots.txt
Domain IPs 200.129.209.136
Response IP 200.129.209.136
Found Yes
Hash 2593f544b774572cef1f2a1c4612ebe4d59933935b127384078cdeca31c405e2
SimHash a8508b4e4d60

Groups

*

Rule Path
Disallow /pos-graduacao/mestrado-doutorado-ciencia-tecnologia-ambiental/dissertacoes-defendidas

Comments

  • Define access-restrictions for robots/spiders
  • http://www.robotstxt.org/wc/norobots.html
  • By default we allow robots to access all areas of our site
  • already accessible to anonymous users