www-nds.iaea.org
robots.txt

Robots Exclusion Standard data for www-nds.iaea.org

Resource Scan

Scan Details

Site Domain www-nds.iaea.org
Base Domain iaea.org
Scan Status Ok
Last Scan2025-03-03T15:40:46+00:00
Next Scan 2025-04-02T15:40:46+00:00

Last Scan

Scanned2025-03-03T15:40:46+00:00
URL https://www-nds.iaea.org/robots.txt
Domain IPs 104.20.49.185, 104.20.50.185, 172.67.17.137, 2606:4700:10::6814:31b9, 2606:4700:10::6814:32b9, 2606:4700:10::ac43:1189
Response IP 104.20.49.185
Found Yes
Hash f5853b1b2fb2b6b2d82b830ce9f0ec6add6e705d1f859584259e0236b7e42757
SimHash 4d1df94d5151

Groups

googlebot

Rule Path
Disallow /exfor/servlet/

google

Rule Path
Disallow /exfor/servlet/

msnbot

Rule Path
Disallow /

picosearch

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

qqdownload

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /nrdc-int/
Disallow /exfor/
Disallow /endf/
Disallow /cinda/
Disallow /nsr/
Disallow /honeypot/