nivito.it
robots.txt
Robots Exclusion Standard data for nivito.it
Resource Scan
Scan Details
Site Domain | nivito.it |
Base Domain | nivito.it |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-11-07T06:38:00+00:00 |
Next Scan | 2025-01-06T06:38:00+00:00 |
Last Successful Scan
Scanned | 2024-08-17T09:29:09+00:00 |
URL | https://nivito.it/robots.txt |
Redirect | https://www.nivito.it/robots.txt |
Redirect Domain | www.nivito.it |
Redirect Base | nivito.it |
Domain IPs | 34.159.239.254 |
Redirect IPs | 34.159.239.254 |
Response IP | 34.159.239.254 |
Found | Yes |
Hash | f431b140107d703e8c874cf4f019658479bb5c544e9f421084f4d4dee26bdeb5 |
SimHash | 0b32c440c892 |
Groups
*
Rule | Path |
---|---|
Disallow | /nogooglebot/ |
Disallow | /app/ |
Disallow | /.github/ |
Disallow | /bin/ |
Disallow | /db-backup/ |
Disallow | /dev/ |
Disallow | /generated/ |
Disallow | /lib/ |
Disallow | /phpserver/ |
Disallow | /app/ |
Disallow | /setup/ |
Disallow | /update/ |
Disallow | /var/ |
Disallow | /vendor/ |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
Other Records
Field | Value |
---|---|
sitemap | https://www.nivito.it/pub/sitemap/it_IT.xml |