soyoung.com
robots.txt

Robots Exclusion Standard data for soyoung.com

Resource Scan

Scan Details

Site Domain soyoung.com
Base Domain soyoung.com
Scan Status Ok
Last Scan2024-05-06T12:15:18+00:00
Next Scan 2024-05-20T12:15:18+00:00

Last Scan

Scanned2024-05-06T12:15:18+00:00
URL https://www.soyoung.com/robots.txt
Domain IPs 163.181.128.234, 163.181.128.235, 163.181.160.224, 163.181.160.225, 163.181.164.221, 163.181.164.222, 163.181.166.237, 163.181.166.238, 163.181.42.239, 163.181.42.240, 163.181.81.233, 163.181.81.234, 163.181.82.165, 163.181.82.166
Response IP 163.181.128.232
Found Yes
Hash 39a736f91aaa482c34bddbb89a77ff4f3fd3e34b289a8d7dbaa7d0ab92157ae1
SimHash 0814f872a741

Groups

*

Rule Path
Disallow /online
Disallow /passport/
Disallow /p1418816p1p1h0
Disallow /p1451870
Disallow /p5029567
Disallow /p5006455
Disallow /u163469
Disallow /p5003531p1p1
Disallow /p5003531
Disallow /hospital/21452/*
Disallow /hospital/nphoto/*

easouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7200