meaniit.com
robots.txt

Robots Exclusion Standard data for meaniit.com

Resource Scan

Scan Details

Site Domain meaniit.com
Base Domain meaniit.com
Scan Status Ok
Last Scan4/8/2025, 7:47:59 PM
Next Scan 4/15/2025, 7:47:59 PM

Last Scan

Scanned4/8/2025, 7:47:59 PM
URL https://meaniit.com/robots.txt
Domain IPs 3.165.102.103, 3.165.102.12, 3.165.102.127, 3.165.102.59
Response IP 3.165.102.59
Found Yes
Hash b0f2b90878a11e3679643d842e6690ff3d92d00c2a7a58b8996af913dec1aae1
SimHash 49857441c170

Groups

googlebot
googlebot-image
daum
daumoa
yeti
zumbot
twitterbot
bingbot
msnbot
ia_archiver
applebot

Rule Path
Allow /reporter
Allow /reporter/*
Allow /reporter/bigtech-bigmove-1/*
Allow /reporter/bigmoney-bigmove-2/*
Allow /researcher
Allow /login
Disallow /mypage
Disallow /auth/*
Disallow /researcher/result/*
Disallow /researcher?redirected=true

mediapartners-google

Rule Path
Allow /
Allow /reporter
Allow /reporter/*
Allow /researcher
Allow /login
Disallow /mypage
Disallow /auth/*
Disallow /researcher/result/*
Disallow /researcher?redirected=true

*

Rule Path
Disallow /
Disallow /mypage
Disallow /auth/*
Disallow /researcher/result/*
Disallow /researcher?redirected=true

Other Records

Field Value
sitemap https://ko.meaniit.com/sitemap.xml

Comments

  • 주요 검색 엔진 크롤러에 대한 허용 규칙
  • Google Ads 관련 크롤러
  • 기타 크롤러에 대한 기본 규칙
  • 사이트맵 경로