top.skor.id
robots.txt

Robots Exclusion Standard data for top.skor.id

Resource Scan

Scan Details

Site Domain top.skor.id
Base Domain skor.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-04T09:45:49+00:00
Next Scan 2024-11-02T09:45:49+00:00

Last Successful Scan

Scanned2022-06-15T21:06:24+00:00
URL https://top.skor.id/robots.txt
Redirect https://topskor.pikiran-rakyat.com:443/robots.txt
Redirect Domain topskor.pikiran-rakyat.com
Redirect Base pikiran-rakyat.com
Response IP 13.227.254.44
Found Yes
Hash 1557212381bcd5791654708522f2e4a76922b55e750f0d1d11dfb02080757edd
SimHash 4949c967a7b1

Groups

*
googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://topskor.pikiran-rakyat.com/sitemap.xml
sitemap https://topskor.pikiran-rakyat.com/sitemap-news.xml
sitemap https://topskor.pikiran-rakyat.com/sitemap-web.xml