sinarmas.co.id
robots.txt

Robots Exclusion Standard data for sinarmas.co.id

Resource Scan

Scan Details

Site Domain sinarmas.co.id
Base Domain sinarmas.co.id
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-13T23:52:35+00:00
Next Scan 2025-12-12T23:52:35+00:00

Last Successful Scan

Scanned2025-07-23T17:56:05+00:00
URL https://www.sinarmas.co.id/robots.txt
Domain IPs 34.101.131.234
Response IP 34.101.131.234
Found Yes
Hash fb4749842116da8e9c5c46668c2d4a9dd18496419430f615cf4fe28b2dbb4124
SimHash 6d14f355c551

Groups

*
googlebot
googlebot-image/1.0
googlebot-video/1.0
bingbot
slurp
duckduckbot
baiduspider
yandexbot
facebot
ia_archiver
adsbot-google

Product Comment
slurp Yahoo
facebot Facebook
ia_archiver Alexa
Rule Path
Allow /