ildigitale.it
robots.txt
Robots Exclusion Standard data for ildigitale.it
Resource Scan
Scan Details
Site Domain | ildigitale.it |
Base Domain | ildigitale.it |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-21T21:55:51+00:00 |
Next Scan | 2024-11-20T21:55:51+00:00 |
Last Successful Scan
Scanned | 2024-07-24T21:54:21+00:00 |
URL | https://ildigitale.it/robots.txt |
Redirect | https://www.ildigitale.it/robots.txt |
Redirect Domain | www.ildigitale.it |
Redirect Base | ildigitale.it |
Domain IPs | 65.21.200.31 |
Redirect IPs | 65.21.200.31 |
Response IP | 65.21.200.31 |
Found | Yes |
Hash | e660b0225df767b9d4f12da826a99a3d94d29606b67ccb88e20f7462655b8dc4 |
SimHash | 49445844ce12 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | *.jpg |
Allow | *.js |
Allow | *.css |
Disallow | /search/ |
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /consiglia/ |