my.crowdworks.kr
robots.txt

Robots Exclusion Standard data for my.crowdworks.kr

Resource Scan

Scan Details

Site Domain my.crowdworks.kr
Base Domain crowdworks.kr
Scan Status Ok
Last Scan2025-08-30T21:50:21+00:00
Next Scan 2025-09-29T21:50:21+00:00

Last Scan

Scanned2025-08-30T21:50:21+00:00
URL https://my.crowdworks.kr/robots.txt
Domain IPs 13.35.37.122, 13.35.37.36, 13.35.37.42, 13.35.37.58, 2600:9000:213e:1c00:11:95e0:a7c0:93a1, 2600:9000:213e:4800:11:95e0:a7c0:93a1, 2600:9000:213e:4e00:11:95e0:a7c0:93a1, 2600:9000:213e:6a00:11:95e0:a7c0:93a1, 2600:9000:213e:7400:11:95e0:a7c0:93a1, 2600:9000:213e:7800:11:95e0:a7c0:93a1, 2600:9000:213e:8400:11:95e0:a7c0:93a1, 2600:9000:213e:de00:11:95e0:a7c0:93a1
Response IP 13.35.37.36
Found Yes
Hash bf5ab9fcce3921a6809a525f51e80683c38fdc14233cdbaa6949548ce0cf0415
SimHash 04695f824333

Groups

*

Rule Path
Disallow /
Disallow /member/
Disallow /activity/
Disallow /proceeds/
Disallow /history/
Disallow /cs/
Disallow /callback/

Comments

  • https://www.robotstxt.org/robotstxt.html