www.comune.lissone.mb.it
robots.txt
Robots Exclusion Standard data for www.comune.lissone.mb.it
Resource Scan
Scan Details
Site Domain | www.comune.lissone.mb.it |
Base Domain | lissone.mb.it |
Scan Status | Ok |
Last Scan | 2024-05-31T15:28:48+00:00 |
Next Scan | 2024-06-30T15:28:48+00:00 |
Last Scan
Scanned | 2024-05-31T15:28:48+00:00 |
URL | https://www.comune.lissone.mb.it/robots.txt |
Domain IPs | 18.66.218.32, 18.66.218.58, 18.66.218.86, 18.66.218.88 |
Response IP | 52.85.243.22 |
Found | Yes |
Hash | c8d63def7482193f0d9d01fbe39c06a16a2465f93c14afbe5353cc76fbbbe284 |
SimHash | 8410da22a3d8 |
Groups
*
Rule | Path |
---|---|
Disallow | /flex/tmp/ |
Disallow | /flex/Logs/ |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |