top500.larena.it
robots.txt
Robots Exclusion Standard data for top500.larena.it
Resource Scan
Scan Details
Site Domain | top500.larena.it |
Base Domain | larena.it |
Scan Status | Ok |
Last Scan | 2024-04-26T12:10:04+00:00 |
Next Scan | 2024-05-26T12:10:04+00:00 |
Last Scan
Scanned | 2024-04-26T12:10:04+00:00 |
URL | https://top500.larena.it/robots.txt |
Domain IPs | 156.54.131.85 |
Response IP | 156.54.131.85 |
Found | Yes |
Hash | 6b4fdf4d15e8830e0e68f1c55ba3e000222c9a0aae8220ad964934a3012b8340 |
SimHash | 00048960c331 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /topics |
Disallow | /altro/ricerca |
Disallow | /t/ |
Disallow | /q/ |