dzs-z.hu
robots.txt

Robots Exclusion Standard data for dzs-z.hu

Resource Scan

Scan Details

Site Domain dzs-z.hu
Base Domain dzs-z.hu
Scan Status Ok
Last Scan2024-10-01T22:47:47+00:00
Next Scan 2024-10-08T22:47:47+00:00

Last Scan

Scanned2024-10-01T22:47:47+00:00
URL https://dzs-z.hu/robots.txt
Redirect http://www.dzs-z.hu/robots.txt
Redirect Domain www.dzs-z.hu
Redirect Base dzs-z.hu
Domain IPs 185.187.73.179
Redirect IPs 185.187.73.179
Response IP 185.187.73.179
Found Yes
Hash 260e0f7ab6e49c7e6727da2a84a7e89cfef00b46cd25c11e79f60a33f3f6612e
SimHash 31776f480fc3

Groups

*

Rule Path
Disallow

*

Rule Path
Disallow /Kepek/

*

Rule Path
Disallow /Zene/

*

Rule Path
Disallow /cgi-bin/

Comments

  • All robots will spider the domain
  • Disallow directory /docs/