nyu.hu
robots.txt

Robots Exclusion Standard data for nyu.hu

Resource Scan

Scan Details

Site Domain nyu.hu
Base Domain nyu.hu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-24T11:04:05+00:00
Next Scan 2024-05-31T11:04:05+00:00

Last Successful Scan

Scanned2024-02-06T03:31:30+00:00
URL https://nyu.hu/robots.txt
Redirect https://www.nyu.hu/robots.txt
Redirect Domain www.nyu.hu
Redirect Base nyu.hu
Domain IPs 104.22.18.82, 104.22.19.82, 172.67.25.245, 2606:4700:10::6816:1252, 2606:4700:10::6816:1352, 2606:4700:10::ac43:19f5
Redirect IPs 104.22.18.82, 104.22.19.82, 172.67.25.245, 2606:4700:10::6816:1252, 2606:4700:10::6816:1352, 2606:4700:10::ac43:19f5
Response IP 104.22.19.82
Found Yes
Hash 2d4661d715e668000b15b429cc59f3a14ffbda966852fd6462af0cc2a587ef51
SimHash d415e7544558

Groups

*

Rule Path
Disallow /account
Disallow /adm
Disallow /acomment_apply
Disallow /changepass
Disallow /cikk/pdf
Disallow /cikk2
Disallow /cikkhozzaszolasok
Disallow /cikkkereses
Disallow /cikknyomtat
Disallow /cikkpdf
Disallow /cimke
Disallow /facebooklogin
Disallow /galeria
Disallow /galfel
Disallow /info
Disallow /jelentem
Disallow /login
Disallow /logout
Disallow /lostpass
Disallow /lostpass2
Disallow /observer
Disallow /preview
Disallow /register
Disallow /register2
Disallow /register3
Disallow /szerzo
Disallow /test
Disallow /theme
Disallow /upload
Disallow /vote_ajax
Disallow /vote_apply_ajax