idus.com
robots.txt
Robots Exclusion Standard data for idus.com
Resource Scan
Scan Details
| Site Domain | idus.com |
| Base Domain | idus.com |
| Scan Status | Ok |
| Last Scan | 2024-06-26T22:05:56+00:00 |
| Next Scan | 2024-07-03T22:05:56+00:00 |
Last Scan
| Scanned | 2024-06-26T22:05:56+00:00 |
| URL | https://idus.com/robots.txt |
| Redirect | https://www.idus.com/robots.txt |
| Redirect Domain | www.idus.com |
| Redirect Base | idus.com |
| Domain IPs | 18.155.68.14, 18.155.68.17, 18.155.68.59, 18.155.68.75 |
| Redirect IPs | 18.155.68.14, 18.155.68.17, 18.155.68.59, 18.155.68.75 |
| Response IP | 18.155.68.14 |
| Found | Yes |
| Hash | 196c733e5ff7f7d1c1af0d03f331a7263d7ab73eb71acddacc61368ce71f78ab |
| SimHash | c6940e10a243 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
googlebot-image
yeti
naverbot
daum
daumoa
kakaotalk-scrap
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /w/naver/ |
| Disallow | /w/kakao/ |
| Disallow | /w/twitter/ |
| Disallow | /w/facebook/ |
| Disallow | /w/artist/47fca207-3f55-4ca1-874b-d3d2a341e3d7 |
| Disallow | /w/artist/814ce49a-9aa0-4333-9ef3-a3398cdbe134 |
| Disallow | /w/artist/fc8a1e35-05cc-4aed-90cb-9c64f5673cdb |
| Disallow | /w/artist/b97871c3-2666-4372-bad8-25842d7b52f9 |
| Disallow | /w/artist/c0bbb853-aaab-4894-9b58-2148346efc16 |
| Disallow | /w/artist/b4b928b1-56a4-49d4-9d8e-cc51e0431f11 |
| Disallow | /w/artist/d0eb5052-aa75-4fe4-a0d2-3a316e81ce96 |
| Disallow | /w/artist/1d4c47e0-56ed-4a71-b98f-2ee9713b912c |
| Disallow | /w/artist/e3eee555-441a-440d-b48a-be5ed94a5122 |
| Disallow | /w/artist/f6e9381f-334e-4814-8f11-41522d3b8d2f |
| Disallow | /w/artist/b64b75b0-0233-4810-8cc4-9b32520d21f2 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /w/naver/ |
| Disallow | /w/kakao/ |
| Disallow | /w/twitter/ |
| Disallow | /w/facebook/ |
| Disallow | /w/artist/47fca207-3f55-4ca1-874b-d3d2a341e3d7 |
| Disallow | /w/artist/814ce49a-9aa0-4333-9ef3-a3398cdbe134 |
| Disallow | /w/artist/fc8a1e35-05cc-4aed-90cb-9c64f5673cdb |
| Disallow | /w/artist/b97871c3-2666-4372-bad8-25842d7b52f9 |
| Disallow | /w/artist/c0bbb853-aaab-4894-9b58-2148346efc16 |
| Disallow | /w/artist/b4b928b1-56a4-49d4-9d8e-cc51e0431f11 |
| Disallow | /w/artist/d0eb5052-aa75-4fe4-a0d2-3a316e81ce96 |
| Disallow | /w/artist/1d4c47e0-56ed-4a71-b98f-2ee9713b912c |
| Disallow | /w/artist/e3eee555-441a-440d-b48a-be5ed94a5122 |
| Disallow | /w/artist/f6e9381f-334e-4814-8f11-41522d3b8d2f |
| Disallow | /w/artist/b64b75b0-0233-4810-8cc4-9b32520d21f2 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3600 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.idus.com/sitemap.xml |
Warnings
- 1 invalid line.