esade.edu
robots.txt
Robots Exclusion Standard data for esade.edu
Resource Scan
Scan Details
| Site Domain | esade.edu |
| Base Domain | esade.edu |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-23T20:28:00+00:00 |
| Next Scan | 2026-02-21T20:28:00+00:00 |
Last Successful Scan
| Scanned | 2025-01-05T12:27:12+00:00 |
| URL | https://www.esade.edu/robots.txt |
| Domain IPs | 13.225.4.104, 13.225.4.29, 13.225.4.33, 13.225.4.53, 2600:9000:221e:200:10:ddf8:b140:93a1, 2600:9000:221e:4000:10:ddf8:b140:93a1, 2600:9000:221e:600:10:ddf8:b140:93a1, 2600:9000:221e:800:10:ddf8:b140:93a1, 2600:9000:221e:8200:10:ddf8:b140:93a1, 2600:9000:221e:8c00:10:ddf8:b140:93a1, 2600:9000:221e:bc00:10:ddf8:b140:93a1, 2600:9000:221e:e800:10:ddf8:b140:93a1 |
| Response IP | 13.225.4.104 |
| Found | Yes |
| Hash | 5e804ce503c79ca2e18300518d8530feb83ea1e45bf087a4fcbb512a90fe0291 |
| SimHash | 758bc6d6c742 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pfw_files/cma/Doctorado_management/ |
| Disallow | /profesorado/cv/ |
| Disallow | /professorat/cv/ |
| Disallow | /faculty/cv/ |
| Disallow | /ptmba2012/ |
| Disallow | /llm/ |
| Disallow | /saw/ |
| Disallow | /biblio/ |
| Disallow | /rss/ |
| Disallow | /podcast/3__14__1861/ |
| Disallow | /app/ |
| Disallow | /page/esp/law/ |
| Disallow | /web/eng/error/ |
| Disallow | /servlet/page/web/error/ |
| Disallow | /movingesade/ |
| Disallow | /escuela-idiomas/ |
| Disallow | /pfw_files/cma/GUIAME/ |
| Disallow | /admisiones/css/ |
| Disallow | /pls/orasso/ |
| Disallow | /homesite/esp/cladea-2014/ |
| Disallow | /homesite/esp/scmwc/ |
| Disallow | /homesite/eng/cladea-2014/ |
| Disallow | /homesite/eng/scmwc/ |
| Disallow | /homesite/cat/cladea-2014/ |
| Disallow | /homesite/cat/scmwc/ |
| Disallow | /jornadas-seminarios-foros-derecho/ |
| Disallow | /latam/ |
| Disallow | /cde/ |
| Disallow | /mailing/ |
| Disallow | /modules/ |
| Disallow | /sites/all/ |
| Disallow | /grados/eng/multimedia/ |
| Disallow | /grados/cat/multimedia/ |
| Disallow | /grados/esp/multimedia/ |
| Disallow | /masterabogacia/cat/noticias/ |
| Disallow | /masterabogacia/esp/noticias/ |
| Disallow | /public/modules.php |
| Disallow | /en/studentf1rst/ |
| Disallow | /es/studentf1rst/ |
| Disallow | /ca/studentf1rst/ |
| Disallow | /execmastersportsmanagement/ |
| Disallow | /web/esp/search/ |
| Disallow | /web/eng/search/ |
| Disallow | /web/cat/search/ |
| Disallow | /es/faculty/en/ |
| Disallow | /ca/faculty/en/ |
| Disallow | /en/faculty/en/ |
| Disallow | /admissions/carreras/ |
| Disallow | /admissions/cat/ |
| Disallow | /admissions/esp/ |
| Disallow | /admissions/eng/ |
| Disallow | /admisiones/intranet.do |
| Disallow | /admisiones/prepareDocsDownload.do |
| Disallow | /admisiones/checkStatus.do |
| Disallow | /admisiones/modoDePagos.do |
| Disallow | /admissions/posderecho_/ |
| Disallow | /es/program/en/ |
| Disallow | /ca/program/en/ |
| Disallow | /en/program/en/ |
| Disallow | /library/cat/erecursos/ |
| Disallow | /library/esp/erecursos/ |
| Disallow | /library/eng/erecursos/ |
| Disallow | /itemsweb/content/ |
| Disallow | /itemsweb/coursesurveys/ |
| Disallow | /cedit/ |
| Disallow | /cedit2004/ |
| Disallow | /cedit2003/ |
| Allow | /core/*.css$ |
| Allow | /core/*.css? |
| Allow | /core/*.js$ |
| Allow | /core/*.js? |
| Allow | /core/*.gif |
| Allow | /core/*.jpg |
| Allow | /core/*.jpeg |
| Allow | /core/*.png |
| Allow | /core/*.svg |
| Allow | /profiles/*.css$ |
| Allow | /profiles/*.css? |
| Allow | /profiles/*.js$ |
| Allow | /profiles/*.js? |
| Allow | /profiles/*.gif |
| Allow | /profiles/*.jpg |
| Allow | /profiles/*.jpeg |
| Allow | /profiles/*.png |
| Allow | /profiles/*.svg |
| Disallow | /core/ |
| Disallow | /profiles/ |
| Disallow | /README.txt |
| Disallow | /web.config |
| Disallow | /admin/ |
| Disallow | /comment/reply/ |
| Disallow | /filter/tips/ |
| Disallow | /node/add/ |
| Disallow | /user/register/ |
| Disallow | /user/password/ |
| Disallow | /user/login/ |
| Disallow | /user/logout/ |
| Disallow | /index.php/admin/ |
| Disallow | /index.php/comment/reply/ |
| Disallow | /index.php/filter/tips/ |
| Disallow | /index.php/node/add/ |
| Disallow | /index.php/search/ |
| Disallow | /index.php/user/password/ |
| Disallow | /index.php/user/register/ |
| Disallow | /index.php/user/login/ |
| Disallow | /index.php/user/logout/ |
| Disallow | /taxonomy/ |
| Disallow | /crm/ |
| Disallow | /ea/ |
| Disallow | /newmsc/ |
| Disallow | /portalHelp2/ |
| Disallow | /*? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.esade.edu/executive-education/sitemap.xml |
| sitemap | https://www.esade.edu/masters-law-school/sitemap.xml |
| sitemap | https://www.esade.edu/mba/sitemap.xml |
| sitemap | https://www.esade.edu/bachelor/sitemap.xml |
| sitemap | https://www.esade.edu/summer-school/sitemap.xml |
| sitemap | https://www.esade.edu/research-programmes/sitemap.xml |
| sitemap | https://www.esade.edu/faculty-research/sitemap.xml |
| sitemap | https://www.esade.edu/master-of-science/sitemap.xml |
| sitemap | https://www.esade.edu/sitemap.xml |