beritadiy.com
robots.txt

Robots Exclusion Standard data for beritadiy.com

Resource Scan

Scan Details

Site Domain beritadiy.com
Base Domain beritadiy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-11T16:16:08+00:00
Next Scan 2024-06-09T16:16:08+00:00

Last Successful Scan

Scanned2023-11-13T03:08:08+00:00
URL http://beritadiy.com/robots.txt
Redirect https://beritadiy.pikiran-rakyat.com/robots.txt
Redirect Domain beritadiy.pikiran-rakyat.com
Redirect Base pikiran-rakyat.com
Domain IPs 103.93.129.47
Redirect IPs 103.93.129.34
Response IP 103.93.129.34
Found Yes
Hash 159b4ac1d0ce77be13a1bee60befefc930cd82f212e7af0e2612ac76cbe23ebf
SimHash 49119950e713

Groups

googlebot

Rule Path
Disallow */login
Disallow /login

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://beritadiy.pikiran-rakyat.com/sitemap.xml