thebigdata.co.kr
robots.txt
Robots Exclusion Standard data for thebigdata.co.kr
Resource Scan
Scan Details
| Site Domain | thebigdata.co.kr |
| Base Domain | thebigdata.co.kr |
| Scan Status | Ok |
| Last Scan | 2024-10-04T19:04:20+00:00 |
| Next Scan | 2024-10-11T19:04:20+00:00 |
Last Scan
| Scanned | 2024-10-04T19:04:20+00:00 |
| URL | https://thebigdata.co.kr/robots.txt |
| Domain IPs | 112.175.21.130 |
| Response IP | 112.175.21.130 |
| Found | Yes |
| Hash | 6638bf3bb6225de8b313a4b135e69f059aee487e4979e5617d221acae71713eb |
| SimHash | 831dd9202331 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /json* |
| Disallow | /wcms* |
| Disallow | /skin* |
| Disallow | /inc* |
| Disallow | /extcont* |
| Disallow | /search* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thebigdata.co.kr/sitemap-section-xml.php |