haberet.com
robots.txt

Robots Exclusion Standard data for haberet.com

Resource Scan

Scan Details

Site Domain haberet.com
Base Domain haberet.com
Scan Status Ok
Last Scan2024-11-06T12:32:57+00:00
Next Scan 2024-11-13T12:32:57+00:00

Last Scan

Scanned2024-11-06T12:32:57+00:00
URL https://haberet.com/robots.txt
Redirect https://www.haberet.com/robots.txt
Redirect Domain www.haberet.com
Redirect Base haberet.com
Domain IPs 104.21.90.187, 172.67.159.199, 2606:4700:3031::ac43:9fc7, 2606:4700:3037::6815:5abb
Redirect IPs 104.21.90.187, 172.67.159.199, 2606:4700:3031::ac43:9fc7, 2606:4700:3037::6815:5abb
Response IP 172.67.159.199
Found Yes
Hash 811f5a1fe65c90c7dc74af92b3c1c610abc297732ff315ea52bfe9334ce92cee
SimHash 490cd840cb93

Groups

*

Rule Path
Disallow /ara
Disallow /video-embed
Allow /

Other Records

Field Value
sitemap https://www.haberet.com/export/sitemap
sitemap https://www.haberet.com/export/newsmap