diba.cat
robots.txt
Robots Exclusion Standard data for diba.cat
Resource Scan
Scan Details
| Site Domain | diba.cat |
| Base Domain | diba.cat |
| Scan Status | Ok |
| Last Scan | 2024-10-29T19:34:25+00:00 |
| Next Scan | 2024-11-28T19:34:25+00:00 |
Last Scan
| Scanned | 2024-10-29T19:34:25+00:00 |
| URL | https://diba.cat/robots.txt |
| Redirect | https://www.diba.cat/robots.txt |
| Redirect Domain | www.diba.cat |
| Redirect Base | diba.cat |
| Domain IPs | 45.15.50.151 |
| Redirect IPs | 45.15.50.151 |
| Response IP | 45.15.50.151 |
| Found | Yes |
| Hash | ac436e6df591e88f51cb45e373af7e84f17ca7a9ae0f5caed7950df6fba89ca7 |
| SimHash | fa1cd8535b81 |
Groups
googlebot
bingbot
msnbot
slurp
gsa-crawler
twitterbot
w3c-checklink
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /scripts/ |
| Disallow | /css/ |
| Disallow | /contacte? |
| Disallow | /c/portal/ |
| Disallow | *contactDirectory_WAR_contactdirectoryportlet |
| Disallow | *dibaForm_WAR |
| Disallow | /web/butlletins/butlleti/-/butlletidigital/INTERN2/ |
| Disallow | /web/butlletins/butlleti/-/butlletidigital/INTERN/ |
| Disallow | /web/fem-nadal |
| Disallow | /documents/306225111/306795174/Decret%2BPla%2BConting%C3%A8ncia.pdf/6c1338f1-5835-4adc-9bf4-040986c299d8 |
| Disallow | /documents/306225111/306795174/Decret%2BPla%2BConting%C3%A8ncia.pdf/6c1338f1-5835-4adc-9bf4-040986c299d8 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Comments