webtoon.com
robots.txt
Robots Exclusion Standard data for webtoon.com
Resource Scan
Scan Details
| Site Domain | webtoon.com |
| Base Domain | webtoon.com |
| Scan Status | Ok |
| Last Scan | 2024-11-02T08:45:39+00:00 |
| Next Scan | 2024-11-09T08:45:39+00:00 |
Last Scan
| Scanned | 2024-11-02T08:45:39+00:00 |
| URL | https://webtoon.com/robots.txt |
| Redirect | https://www.webtoons.com/robots.txt |
| Redirect Domain | www.webtoons.com |
| Redirect Base | webtoons.com |
| Domain IPs | 110.93.151.133, 110.93.151.163, 210.89.168.51, 210.89.168.77 |
| Redirect IPs | 203.104.174.129 |
| Response IP | 203.104.174.129 |
| Found | Yes |
| Hash | 47c140304936d3b92da2f019b38ce6771b72064092f5eecbc47551243c187993 |
| SimHash | e11489225561 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /challenge/report |
| Disallow | /*/challenge/dashboard |
| Disallow | /*/challenge/dashboardEpisode |
| Disallow | /challenge/episode |
| Disallow | /challenge/saveEpisode |
| Disallow | /*/challenge/changeEpisodeStatus |
| Disallow | /challenge/removeEpisode |
| Disallow | /*/challenge/publish |
| Disallow | /*/challenge/series |
| Disallow | /*/challenge/saveTitle |
| Disallow | /member/login |
| Disallow | /member/logout |
| Disallow | /*/favorite |
| Disallow | /*/account |
| Disallow | /*/settings/account |
| Disallow | /*/search |
| Disallow | /*/notice/detail?noticeNo=*&page= |
| Disallow | /*/notice/list?page= |
| Allow | /*/notice/list?page=1$ |
| Allow | /*/notice/list?page=2$ |
| Disallow | /*/*/*/list?title_no=*&page=1 |
Comments