ufrgs.br
robots.txt

Robots Exclusion Standard data for ufrgs.br

Resource Scan

Scan Details

Site Domain ufrgs.br
Base Domain ufrgs.br
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-20T01:01:27+00:00
Next Scan 2024-08-18T01:01:27+00:00

Last Successful Scan

Scanned2022-06-27T05:50:41+00:00
URL https://ufrgs.br/robots.txt
Redirect https://www.ufrgs.br/robots.txt
Redirect Domain www.ufrgs.br
Redirect Base ufrgs.br
Response IP 143.54.2.20
Found Yes
Hash 62d27763477ee1dc5e312529424b525ad8a913e54caaf6c62c7a822ff81df31f
SimHash ae3498622783

Groups

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /rt/
Disallow /phpmyadmin/
Disallow /phppgadmin/
Disallow /hospedagem/
Disallow /testehospedagem/
Disallow /twiki/
Disallow /bloqueio/
Disallow /bloqueados/
Disallow /sead1/forumead/
Disallow /ufrgs/inicial/comunicacao/jornal