kembangjoyo.co.id
robots.txt

Robots Exclusion Standard data for kembangjoyo.co.id

Resource Scan

Scan Details

Site Domain kembangjoyo.co.id
Base Domain kembangjoyo.co.id
Scan Status Ok
Last Scan4/9/2025, 8:08:11 PM
Next Scan 4/16/2025, 8:08:11 PM

Last Scan

Scanned4/9/2025, 8:08:11 PM
URL https://kembangjoyo.co.id/robots.txt
Domain IPs 51.79.150.65
Response IP 51.79.150.65
Found Yes
Hash 509726500e6eef6c3367bc7a590e9727f52677c09edf6556a73bcf6e896e8c08
SimHash 229440171ddb

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Disallow /

feed

Rule Path
Disallow /

nbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

unknown robot identified by bot\*

Rule Path
Disallow /

ahrefsbot
sogou web spider
dotbot
applebot
bingpreview
survey
duckduckgo-favicons-bot
archive.org_bot
yandex
crawl
wget
unknown
seznambot
baidu
baiduspider
phantomjs
mail
dalvik
cfnetwork
mojeekbot
duckduckgo-favicons-bot
dotbot
mj12bot
httrack
domainstatsbot
obot
cliqzbot
python-urllib
scanner
telegrambot
komodiabot
surdotlybot
mail.ru
ccbot
batchftp
bigfoot
black.hole
feed
nbot
unknown robot (identified by hit on robots.txt)

Rule Path
Disallow /

Other Records

Field Value
sitemap https://kembangjoyo.co.id/sitemap.php

Warnings

  • 1 invalid line.