tvrehberi.milliyet.com.tr
robots.txt

Robots Exclusion Standard data for tvrehberi.milliyet.com.tr

Resource Scan

Scan Details

Site Domain tvrehberi.milliyet.com.tr
Base Domain milliyet.com.tr
Scan Status Ok
Last Scan2024-10-30T23:41:55+00:00
Next Scan 2024-11-06T23:41:55+00:00

Last Scan

Scanned2024-10-30T23:41:55+00:00
URL https://tvrehberi.milliyet.com.tr/robots.txt
Redirect https://www.milliyet.com.tr/robots.txt
Redirect Domain www.milliyet.com.tr
Redirect Base milliyet.com.tr
Domain IPs 83.66.162.165
Redirect IPs 51.161.197.225, 51.79.231.108
Response IP 51.161.197.225
Found Yes
Hash c6cfe7e84668b88e3969269c5f8c4c4c1bae2689cbe1265186ddbc6563a8adae
SimHash 90449a60e312

Groups

*

Rule Path
Disallow /root/*
Disallow /arama/
Disallow /Milliyet.aspx

gptbot

Rule Path
Disallow /