indico.cern.ch
robots.txt
Robots Exclusion Standard data for indico.cern.ch
Resource Scan
Scan Details
| Site Domain | indico.cern.ch |
| Base Domain | cern.ch |
| Scan Status | Ok |
| Last Scan | 2024-05-22T12:49:05+00:00 |
| Next Scan | 2024-06-21T12:49:05+00:00 |
Last Scan
| Scanned | 2024-05-22T12:49:05+00:00 |
| URL | https://indico.cern.ch/robots.txt |
| Domain IPs | 188.184.23.103, 188.185.77.15, 2001:1458:d00:34::100:aa, 2001:1458:d00:9::100:109 |
| Response IP | 188.184.23.103 |
| Found | Yes |
| Hash | adaa034d8eb1bdf839f3809ba76075f523ec5b173b0885d11b447e8d21760ebe |
| SimHash | c849cc456e76 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /category/*/calendar |
| Disallow | /category/*/overview |
| Disallow | /category/*/upcoming |
| Disallow | /search/* |
| Disallow | /api/* |
| Disallow | /admin/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments