trthaber.com
robots.txt

Robots Exclusion Standard data for trthaber.com

Resource Scan

Scan Details

Site Domain trthaber.com
Base Domain trthaber.com
Scan Status Ok
Last Scan2024-11-09T18:49:09+00:00
Next Scan 2024-11-16T18:49:09+00:00

Last Scan

Scanned2024-11-09T18:49:09+00:00
URL https://trthaber.com/robots.txt
Redirect https://www.trthaber.com/robots.txt
Redirect Domain www.trthaber.com
Redirect Base trthaber.com
Domain IPs 52.29.152.27
Redirect IPs 52.29.152.27
Response IP 52.29.152.27
Found Yes
Hash c7e42748c14252b582e6c7f047d2a59a7396dc854c4c3f2cc9357d9cfc2dac16
SimHash 8808c222cf71

Groups

*

Rule Path
Allow /
Disallow /arama.html
Disallow /haber/hava-durumu/

ia_archiver

Rule Path
Disallow

alexabot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.trthaber.com/sitemap_haber.xml
sitemap https://www.trthaber.com/sitemap.xml
sitemap https://www.trthaber.com/sitemaps/news.xml
sitemap https://www.trthaber.com/sitemaps/galleries.xml
sitemap https://www.trthaber.com/sitemaps/videos.xml
sitemap https://www.trthaber.com/sitemaps/programs.xml
sitemap https://www.trthaber.com/sitemaps/trt-news.xml
sitemap https://www.trthaber.com/sitemaps/infographics.xml
sitemap https://www.trthaber.com/sitemaps/podcasts.xml