uab.cat
robots.txt

Robots Exclusion Standard data for uab.cat

Resource Scan

Scan Details

Site Domain uab.cat
Base Domain uab.cat
Scan Status Ok
Last Scan2025-03-30T03:02:16+00:00
Next Scan 2025-04-29T03:02:16+00:00

Last Scan

Scanned2025-03-30T03:02:16+00:00
URL https://uab.cat/robots.txt
Redirect https://www.uab.cat/robots.txt
Redirect Domain www.uab.cat
Redirect Base uab.cat
Domain IPs 158.109.120.133
Redirect IPs 158.109.120.133
Response IP 158.109.120.133
Found Yes
Hash 0fc9efea4667a03a750361deeb6f8753e6b6bb8dee295978eba9d06a794dcb03
SimHash 68004e844307

Groups

*

Rule Path
Disallow /admin/
Disallow /internal/
Disallow /servlet/jsp/
Disallow /PDF/UAB-programa*
Disallow /servlet/ContentServer/
Disallow /document/postgrau/doctorat/admissions-ed/*
Disallow /servlet/Satellite/el-departamento/horaris-de-secretaria-1266564926082.html
Disallow /servlet/Satellite/el-departament/horaris-de-secretaria-1264665000242.html
Disallow /servlet/Satellite?blobcol=urldocument&blobheader=application%2Fpdf&blobkey=id&blobnocache=true&blobtable=Document&blobwhere=1345654941376&ssbinary=true
Disallow /*param3%3D*
Disallow /*param4%3D*
Disallow /*param5%3D*
Disallow /*param6%3D*
Disallow *TemplatePageMemoriaImprimir*
Disallow *setletertype*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10