sahar.id
robots.txt

Robots Exclusion Standard data for sahar.id

Resource Scan

Scan Details

Site Domain sahar.id
Base Domain sahar.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-09T10:45:02+00:00
Next Scan 2026-03-09T10:45:02+00:00

Last Successful Scan

Scanned2023-05-23T11:16:25+00:00
URL https://sahar.id/robots.txt
Redirect https://www.sahar.id/robots.txt
Redirect Domain www.sahar.id
Redirect Base sahar.id
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.10.121, 2404:6800:4003:c01::79
Response IP 74.125.68.121
Found Yes
Hash 50885c02f778b2a448e2b9bc430a39ce55c468ecc4c10039d69fc274ac2e4005
SimHash 0b04d6604e93

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.sahar.id/sitemap.xml