esrf.eu
robots.txt
Robots Exclusion Standard data for esrf.eu
Resource Scan
Scan Details
Site Domain | esrf.eu |
Base Domain | esrf.eu |
Scan Status | Ok |
Last Scan | 2024-09-25T15:58:33+00:00 |
Next Scan | 2024-10-25T15:58:33+00:00 |
Last Scan
Scanned | 2024-09-25T15:58:33+00:00 |
URL | https://esrf.eu/robots.txt |
Redirect | https://www.esrf.fr/robots.txt |
Redirect Domain | www.esrf.fr |
Redirect Base | esrf.fr |
Domain IPs | 193.49.43.142 |
Redirect IPs | 184.87.193.73, 184.87.193.84, 2600:1413:b000:1e::17d1:2e4e, 2600:1413:b000:1e::17d1:2e5b |
Response IP | 23.45.207.173 |
Found | Yes |
Hash | 89475c8e72dbe7401ec3681076a79e5cf4b63cb8a05095e9a8f4a287a0d2e293 |
SimHash | 214148fde6b4 |
Groups
*
Rule | Path |
---|---|
Disallow | /Pics |
Disallow | /adc |
Disallow | /cgi-bin |
Disallow | /gen_gifs |
Disallow | /gifs |
Disallow | /misc_gifs |
Disallow | /newweb |
Disallow | /old |
Disallow | /swish |
Disallow | /symbols |
Disallow | /system_gifs |
Disallow | /test |
Disallow | /staff-only |
Disallow | /exp_facilities/template |
Disallow | /tango |
Disallow | /seminar |
Disallow | /*/printview |
Disallow | /*/localSearch_view |
Comments