ilgilihaber.hurriyet.com.tr
robots.txt
Robots Exclusion Standard data for ilgilihaber.hurriyet.com.tr
Resource Scan
Scan Details
Site Domain | ilgilihaber.hurriyet.com.tr |
Base Domain | hurriyet.com.tr |
Scan Status | Ok |
Last Scan | 2024-04-29T09:20:45+00:00 |
Next Scan | 2024-05-06T09:20:45+00:00 |
Last Scan
Scanned | 2024-04-29T09:20:45+00:00 |
URL | https://ilgilihaber.hurriyet.com.tr/robots.txt |
Redirect | https://www.hurriyet.com.tr/robots.txt |
Redirect Domain | www.hurriyet.com.tr |
Redirect Base | hurriyet.com.tr |
Domain IPs | 83.66.162.50 |
Redirect IPs | 51.161.197.225, 51.161.209.128, 51.79.231.108 |
Response IP | 51.161.209.128 |
Found | Yes |
Hash | d0366206be724949c7a10328ec84ba45df7872693e9677bb4ffd3afcec78c2fd |
SimHash | 10680653ff1e |
Groups
*
Rule | Path |
---|---|
Disallow | /ad/ |
Disallow | /api/ |
Disallow | /arkadasimamektup/ |
Disallow | /okurtemsilcisi/ |
Disallow | /widgets/ |
Disallow | /_includes/ |
Disallow | /_othernews/ |
Disallow | /_test/ |
Disallow | /_includescms/ |
Disallow | /arama/ |