beritadiy.com
robots.txt

Robots Exclusion Standard data for beritadiy.com

Resource Scan

Scan Details

Site Domain beritadiy.com
Base Domain beritadiy.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-07T16:16:40+00:00
Next Scan 2024-12-06T16:16:40+00:00

Last Successful Scan

Scanned2023-11-13T03:08:08+00:00
URL http://beritadiy.com/robots.txt
Redirect https://beritadiy.pikiran-rakyat.com/robots.txt
Redirect Domain beritadiy.pikiran-rakyat.com
Redirect Base pikiran-rakyat.com
Domain IPs 103.93.129.47
Redirect IPs 103.93.129.34
Response IP 103.93.129.34
Found Yes
Hash 159b4ac1d0ce77be13a1bee60befefc930cd82f212e7af0e2612ac76cbe23ebf
SimHash 49119950e713

Groups

googlebot

Rule Path
Disallow */login
Disallow /login

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://beritadiy.pikiran-rakyat.com/sitemap.xml