osservatoreromano.va
robots.txt
Robots Exclusion Standard data for osservatoreromano.va
Resource Scan
Scan Details
Site Domain | osservatoreromano.va |
Base Domain | osservatoreromano.va |
Scan Status | Ok |
Last Scan | 2024-11-08T11:22:59+00:00 |
Next Scan | 2024-11-22T11:22:59+00:00 |
Last Scan
Scanned | 2024-11-08T11:22:59+00:00 |
URL | https://www.osservatoreromano.va/robots.txt |
Domain IPs | 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c |
Response IP | 152.199.39.108 |
Found | Yes |
Hash | d31f127e9455049bdd70d98de03ed1622fa143e99ab20dc2ae0e8c86ca12e1f3 |
SimHash | a1051878ef31 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin/ |
Disallow | /var/ |
Disallow | /libs/ |
Disallow | /etc/ |
Disallow | /apps/ |
Disallow | /home/ |
Disallow | /tmp/ |
Disallow | /system/ |
Allow | /etc/clientlibs/ |
Allow | /etc/designs/ |
Allow | /libs/granite/csrf/token.json |
Other Records
Field | Value |
---|---|
sitemap | https://www.osservatoreromano.va/sitemap.xml |