users.unimi.it
robots.txt

Robots Exclusion Standard data for users.unimi.it

Resource Scan

Scan Details

Site Domain users.unimi.it
Base Domain unimi.it
Scan Status Ok
Last Scan2025-12-18T01:47:42+00:00
Next Scan 2025-12-19T01:47:42+00:00

Last Scan

Scanned2025-12-18T01:47:42+00:00
URL http://users.unimi.it/robots.txt
Redirect https://sites.unimi.it/robots.txt
Redirect Domain sites.unimi.it
Redirect Base unimi.it
Domain IPs 159.149.53.51
Redirect IPs 159.149.53.51
Response IP 159.149.53.51
Found Yes
Hash c7af4298c950510941f51779ba570dccf3f0f4dfaf284f87b073a95cbccc5402
SimHash 650ddc45e793

Groups

*

Rule Path
Disallow /ammi_biosc/

Other Records

Field Value
crawl-delay 10

Comments

  • Sitemap: https://sites.unimi.it/sitemap.xml