linuxsoft.cern.ch
robots.txt
Robots Exclusion Standard data for linuxsoft.cern.ch
Resource Scan
Scan Details
Site Domain | linuxsoft.cern.ch |
Base Domain | cern.ch |
Scan Status | Ok |
Last Scan | 2024-05-30T22:36:59+00:00 |
Next Scan | 2024-06-29T22:36:59+00:00 |
Last Scan
Scanned | 2024-05-30T22:36:59+00:00 |
URL | https://linuxsoft.cern.ch/robots.txt |
Domain IPs | 188.184.104.250, 188.184.105.5, 188.184.111.122, 188.184.23.33, 188.184.79.248, 188.184.90.134, 188.184.91.52, 188.185.25.162, 188.185.29.10, 188.185.65.208, 188.185.8.192, 2001:1458:201:e4::100:22c, 2001:1458:201:e4::100:35c, 2001:1458:d00:1::100:408, 2001:1458:d00:2c::100:229, 2001:1458:d00:2d::100:1cb, 2001:1458:d00:2d::100:d4, 2001:1458:d00:34::100:328, 2001:1458:d00:63::100:106, 2001:1458:d00:67::100:429, 2001:1458:d00:68::100:e4, 2001:1458:d00:6f::100:89 |
Response IP | 188.184.111.122 |
Found | Yes |
Hash | da27901a557861ae7f4c900c173895ad07e1f6bf3292f2f7b443f0f6a44faab3 |
SimHash | 68fa5141cb72 |
Groups
*
Rule | Path |
---|---|
Disallow | /enterprise/ |
Disallow | /rhel/ |
Disallow | /oracle/ |
Disallow | /internal/ |
Disallow | /kickstart/ |
Disallow | /layout/ |
Disallow | /onlycern/ |
Disallow | /cern/rhel/ |
Disallow | /cgi-bin/ |
Disallow | *.iso$ |