ddd.uab.cat
robots.txt

Robots Exclusion Standard data for ddd.uab.cat

Resource Scan

Scan Details

Site Domain ddd.uab.cat
Base Domain uab.cat
Scan Status Ok
Last Scan2025-07-24T23:49:35+00:00
Next Scan 2025-08-23T23:49:35+00:00

Last Scan

Scanned2025-07-24T23:49:35+00:00
URL https://ddd.uab.cat/robots.txt
Domain IPs 158.109.2.47
Response IP 158.109.2.47
Found Yes
Hash 469335bcd95158d21f54127c67d227648e263453211466f769bee6ed9a5053e8
SimHash cf1356e8e69f

Groups

*

Rule Path
Disallow /record/*/export
Disallow /record/*/usage
Disallow /record/*/reviews
Disallow /record/*/comments
Disallow /submit
Disallow /youraccount
Disallow /youralerts
Disallow /yourbaskets
Disallow /rev
Disallow /uab
Disallow /usage
Disallow /search
Disallow /*.txt$
Disallow *rm%3Dwrd*
Disallow *action*browse*
Disallow /pub/enllac/enllac14/imatges/morales.JPG
Disallow /pub/bolcre/
Disallow /pub/butcre/
Disallow /pub/butpri/
Disallow /pub/creafintnew/

Other Records

Field Value
crawl-delay 2

baiduspider
baiduspider
baiduspider+
baiduspider-video
baiduspider-image
bytespider
semrushbot
petalbot

Rule Path
Disallow /search

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ddd.uab.cat/sitemap-index.xml