Log In Sign Up

koreabts.xyz
robots.txt

Robots Exclusion Standard data for koreabts.xyz

Resource Scan

Scan Details

Site Domain koreabts.xyz
Base Domain koreabts.xyz
Scan Status Ok
Last Scan3/19/2025, 6:34:15 AM
Next Scan 4/18/2025, 6:34:15 AM

Last Scan

Scanned3/19/2025, 6:34:15 AM
URL https://koreabts.xyz/robots.txt
Domain IPs 104.21.67.57, 172.67.214.147, 2606:4700:3033::6815:4339, 2606:4700:3037::ac43:d693
Response IP 172.67.214.147
Found Yes
Hash 2c8f3448db08e5cdc0a9f0522710c6374a0de0093d31d9f1daa3aa6e2d778aaa
SimHash 455117417610

Groups

screaming frog seo spider

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /user/
Disallow /deposit
Disallow /withdraw/
Disallow /id/user/
Disallow /id/deposit/
Disallow /id/withdraw/

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

googlebot-mobile

Rule Path
Allow

mediapartners-google

Rule Path
Allow

adsbot-google

Rule Path
Allow

adsbot-google-mobile

Rule Path
Allow

applebot

Rule Path
Allow

bingbot

Rule Path
Allow

yandex

Rule Path
Allow

duckduckbot

Rule Path
Allow

qwantify

Rule Path
Allow

msnbot

Rule Path
Allow

slurp

Rule Path
Allow

robozilla

Rule Path
Allow

mj12bot
semrushbot
yandex
yandexbot
zoominfobot
um-ln
mtrobot
safednsbot
bytespider
bitlybot
barkrowle
coccocbot-image
petalbot
dotbot
blexbot
aspiegelbot
baiduspider
trovitbot
mail.ru_bot
seznambot
yisouspider
zh-cn
slackbot
slackbot-linkexpanding
googlebot-news

Rule Path
Disallow /blog/agents/

semrushbot-sa

Rule Path
Allow

semrushbot-si

Rule Path
Allow

yahoo pipes 2.0

Rule Path
Disallow /

researchtools/ose/$

Rule Path
Allow /

researchtools/ose/dotbot$

Rule Path
Allow /

researchtools/ose/just-discovered$

Rule Path
Allow /

researchtools/ose/links$

Rule Path
Allow /

researchtools/ose/pages$

Rule Path
Allow /

researchtools/ose/domains$

Rule Path
Allow /

researchtools/ose/anchors$

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://103.5.47.76/sitemap.xml
Back to top

Comments

  • Keep our news out of actual news
Back to top