importgenius.co.kr
robots.txt

Robots Exclusion Standard data for importgenius.co.kr

Resource Scan

Scan Details

Site Domain importgenius.co.kr
Base Domain importgenius.co.kr
Scan Status Ok
Last Scan2024-09-16T21:59:49+00:00
Next Scan 2024-10-16T21:59:49+00:00

Last Scan

Scanned2024-09-16T21:59:49+00:00
URL https://importgenius.co.kr/robots.txt
Redirect https://www.importgenius.co.kr:443/robots.txt
Redirect Domain www.importgenius.co.kr
Redirect Base importgenius.co.kr
Domain IPs 75.2.65.215, 99.83.217.137
Redirect IPs 151.101.1.55, 151.101.129.55, 151.101.193.55, 151.101.65.55
Response IP 199.232.45.55
Found Yes
Hash 0038b08709b34831cbdb5a247f8cc00ebdcb6e9a2cc4c9a9187b8c01faecc7fa
SimHash c654d3e24235

Groups

*

Rule Path
Disallow /

gptbot
naverbot
yeti
daum
daumoa
yandex
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile
msnbot
bingbot
slurp
robozilla
baiduspider
yahoo-mmcrawler
psbot
yahoo-blogs

Rule Path
Allow /
Disallow /search
Disallow /cn/search
Disallow /fr/search
Disallow /kr/search
Disallow /es/search
Disallow /argentina/search
Disallow /chile/search
Disallow /colombia/search
Disallow /costarica/search
Disallow /ecuador/search
Disallow /india/search
Disallow /panama/search
Disallow /paraguay/search
Disallow /peru/search
Disallow /uruguay/search
Disallow /venezuela/search
Disallow /russia/search
Disallow /ukraine/search
Disallow /vietnam/search
Disallow /cn/russia/search
Disallow /cn/ukraine/search
Disallow /cn/vietnam/search
Disallow /fr/russia/search
Disallow /fr/ukraine/search
Disallow /fr/vietnam/search
Disallow /kr/russia/search
Disallow /kr/ukraine/search
Disallow /kr/vietnam/search
Disallow /es/russia/search
Disallow /es/ukraine/search
Disallow /es/vietnam/search
Disallow /signup/latin_pre_form
Disallow /contact/freeshipment
Disallow /shipping_alert/unpaid
Disallow /recover/post
Disallow /signup/post
Disallow /partners/prepost
Disallow /cancellation/post
Disallow /demo/post
Disallow /contact/company
Disallow /newcard2/post1
Disallow /newcard/post
Disallow /edu/post
Disallow /partners/post
Disallow /contact/inquiry
Disallow /incontact/post
Disallow /newcard/postHash
Disallow /contact/ticket
Disallow /shipping_alert/paid
Disallow /signup/alibaba_post
Disallow /promo/post
Disallow /upgrade/post
Disallow /onetime/post
Disallow /signup/post_latin
Disallow /careers/post
Disallow /signup_chineseimport/post
Disallow /contact/claim
Disallow /signup/addons
Disallow /autocomplete/company
Disallow /signup/post_companies
Disallow /pulse/data_post
Disallow /alibaba/post
Disallow /main/fetchInternationalNumbers

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

robozilla

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.importgenius.co.kr/sitemap-index.xml