haberglobal.com
robots.txt

Robots Exclusion Standard data for haberglobal.com

Resource Scan

Scan Details

Site Domain haberglobal.com
Base Domain haberglobal.com
Scan Status Ok
Last Scan2026-03-11T17:08:12+00:00
Next Scan 2026-03-18T17:08:12+00:00

Last Scan

Scanned2026-03-11T17:08:12+00:00
URL https://haberglobal.com/robots.txt
Domain IPs 104.26.12.83, 104.26.13.83, 172.67.75.125, 2606:4700:20::681a:c53, 2606:4700:20::681a:d53, 2606:4700:20::ac43:4b7d
Response IP 172.67.75.125
Found Yes
Hash b37f86616e4bfd2641c480240157a7302fe47875baf901a27199cdda6dee4b1b
SimHash 6d1c0a12c9b3

Groups

*

Rule Path
Disallow /storage/ads/
Disallow /21845631255
Disallow /arama$
Disallow /arama?
Disallow /video-embed
Allow /

Other Records

Field Value
sitemap https://haberglobal.com/sitemap/news.xml
sitemap https://haberglobal.com/sitemap/sitemap_google_news.xml