magazin.milliyet.com.tr
robots.txt

Robots Exclusion Standard data for magazin.milliyet.com.tr

Resource Scan

Scan Details

Site Domain magazin.milliyet.com.tr
Base Domain milliyet.com.tr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-19T09:15:17+00:00
Next Scan 2024-11-17T09:15:17+00:00

Last Successful Scan

Scanned2024-01-23T07:23:11+00:00
URL http://magazin.milliyet.com.tr/robots.txt
Redirect https://www.milliyet.com.tr/robots.txt
Redirect Domain www.milliyet.com.tr
Redirect Base milliyet.com.tr
Domain IPs 83.66.162.166
Redirect IPs 51.161.197.225
Response IP 51.161.197.225
Found Yes
Hash 9dacae1e832189946994b531a39bf26936e61b24bf014ab52ac38a6c82b821f4
SimHash 94041a406f12

Groups

*

Rule Path
Disallow /root/*
Disallow /arama/
Disallow /Milliyet.aspx