nyugat.hu
robots.txt

Robots Exclusion Standard data for nyugat.hu

Resource Scan

Scan Details

Site Domain nyugat.hu
Base Domain nyugat.hu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-05T00:00:13+00:00
Next Scan 2024-07-12T00:00:13+00:00

Last Successful Scan

Scanned2023-03-31T16:23:45+00:00
URL https://nyugat.hu/robots.txt
Redirect https://www.nyugat.hu/robots.txt
Redirect Domain www.nyugat.hu
Redirect Base nyugat.hu
Domain IPs 104.22.22.120, 104.22.23.120, 172.67.23.96, 2606:4700:10::6816:1678, 2606:4700:10::6816:1778, 2606:4700:10::ac43:1760
Redirect IPs 104.22.22.120, 104.22.23.120, 172.67.23.96, 2606:4700:10::6816:1678, 2606:4700:10::6816:1778, 2606:4700:10::ac43:1760
Response IP 104.22.22.120
Found Yes
Hash 2d4661d715e668000b15b429cc59f3a14ffbda966852fd6462af0cc2a587ef51
SimHash d415e7544558

Groups

*

Rule Path
Disallow /account
Disallow /adm
Disallow /acomment_apply
Disallow /changepass
Disallow /cikk/pdf
Disallow /cikk2
Disallow /cikkhozzaszolasok
Disallow /cikkkereses
Disallow /cikknyomtat
Disallow /cikkpdf
Disallow /cimke
Disallow /facebooklogin
Disallow /galeria
Disallow /galfel
Disallow /info
Disallow /jelentem
Disallow /login
Disallow /logout
Disallow /lostpass
Disallow /lostpass2
Disallow /observer
Disallow /preview
Disallow /register
Disallow /register2
Disallow /register3
Disallow /szerzo
Disallow /test
Disallow /theme
Disallow /upload
Disallow /vote_ajax
Disallow /vote_apply_ajax