www.comune.bisceglie.bt.it
robots.txt
Robots Exclusion Standard data for www.comune.bisceglie.bt.it
Resource Scan
Scan Details
| Site Domain | www.comune.bisceglie.bt.it |
| Base Domain | bisceglie.bt.it |
| Scan Status | Ok |
| Last Scan | 2024-11-03T11:18:54+00:00 |
| Next Scan | 2024-12-03T11:18:54+00:00 |
Last Scan
| Scanned | 2024-11-03T11:18:54+00:00 |
| URL | https://www.comune.bisceglie.bt.it/robots.txt |
| Domain IPs | 195.78.210.236 |
| Response IP | 195.78.210.236 |
| Found | Yes |
| Hash | d1129be5d1fa013fe5e326cf107dc10532c5d08a60a5144e8ca1ccbb3556923d |
| SimHash | 2801d5c156f7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /mc/ |
| Disallow | /images/ |
| Disallow | /*/de/* |
| Disallow | /*/mc/* |
| Disallow | /*/images/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /mc/ |
| Disallow | /images/ |
| Disallow | /*/de/* |
| Disallow | /*/mc/* |
| Disallow | /*/images/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /mc/ |
| Disallow | /images/ |
| Disallow | /*/de/* |
| Disallow | /*/mc/* |
| Disallow | /*/images/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /mc/ |
| Disallow | /images/ |
| Disallow | /*/de/* |
| Disallow | /*/mc/* |
| Disallow | /*/images/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /mc/ |
| Disallow | /images/ |
| Disallow | /*/de/* |
| Disallow | /*/mc/* |
| Disallow | /*/images/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /mc/ |
| Disallow | /images/ |
| Disallow | /*/de/* |
| Disallow | /*/mc/* |
| Disallow | /*/images/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
yahoo-blogs
| Rule | Path |
|---|---|
| Disallow | /de/ |
| Disallow | /mc/ |
| Disallow | /images/ |
| Disallow | /*/de/* |
| Disallow | /*/mc/* |
| Disallow | /*/images/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
Comments