bigpara.hurriyet.com.tr
robots.txt

Robots Exclusion Standard data for bigpara.hurriyet.com.tr

Resource Scan

Scan Details

Site Domain bigpara.hurriyet.com.tr
Base Domain hurriyet.com.tr
Scan Status Ok
Last Scan2024-11-09T16:31:59+00:00
Next Scan 2024-11-16T16:31:59+00:00

Last Scan

Scanned2024-11-09T16:31:59+00:00
URL https://bigpara.hurriyet.com.tr/robots.txt
Domain IPs 51.161.197.225, 51.79.231.108
Response IP 51.161.197.225
Found Yes
Hash dadb978bc6d37f2c031df9405c24d92a7a6435dae1b529e769743675aab78e95
SimHash 2870065fc510

Groups

*

Rule Path
Disallow /Services/
Disallow /inc/
Disallow /M3/
Disallow /M1/
Disallow /Redirect/
Disallow /api/
Disallow /v1/
Disallow /Account/
Disallow /arama/

yandexnews

Rule Path
Allow /yandex-rss

Other Records

Field Value
sitemap https://bigpara.hurriyet.com.tr/SiteMap/Sitemap.xml
sitemap https://bigpara.hurriyet.com.tr/SiteMap/news.xml