wanted.co.kr
robots.txt

Robots Exclusion Standard data for wanted.co.kr

Resource Scan

Scan Details

Site Domain wanted.co.kr
Base Domain wanted.co.kr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-21T00:40:21+00:00
Next Scan 2026-02-04T00:40:21+00:00

Last Successful Scan

Scanned2024-02-24T08:36:43+00:00
URL https://wanted.co.kr/robots.txt
Redirect https://www.wanted.co.kr:443/robots.txt
Redirect Domain www.wanted.co.kr
Redirect Base wanted.co.kr
Domain IPs 13.124.61.132, 43.202.141.174
Redirect IPs 13.124.61.132, 43.202.141.174
Response IP 43.202.141.174
Found Yes
Hash 6ffa4bb017be29fb201e14dc19c41c6d4d944a005bf9838da2a0db7538f015c3
SimHash 49644a72c60b

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /api/
Disallow /login/
Disallow /invite/
Disallow /bookmark/
Disallow /password/
Disallow /profile/
Disallow /matched/
Disallow /my/
Disallow /matchup/
Allow /matchup/intro
Disallow /dashboard/
Allow /dashboard/b2b
Allow /dashboard/welcome
Allow /dashboard/matchupintro
Disallow /company-list
Disallow /referral/
Allow /referral/intro
Disallow /cv/
Allow /cv/intro
Disallow /yo/
Disallow /points/
Allow /points/introduction
Disallow /PointWelcome
Disallow /*.pdf$
Disallow /*.xls$
Disallow /events/*/register

Other Records

Field Value
sitemap https://www.wanted.co.kr/sitemap.xml
sitemap https://www.wanted.co.kr/sitemap_insight_only_company.xml