youtubekids.com
robots.txt
Robots Exclusion Standard data for youtubekids.com
Resource Scan
Scan Details
| Site Domain | youtubekids.com |
| Base Domain | youtubekids.com |
| Scan Status | Ok |
| Last Scan | 2024-06-18T20:19:23+00:00 |
| Next Scan | 2024-07-18T20:19:23+00:00 |
Last Scan
| Scanned | 2024-06-18T20:19:23+00:00 |
| URL | https://youtubekids.com/robots.txt |
| Redirect | https://www.youtubekids.com/robots.txt |
| Redirect Domain | www.youtubekids.com |
| Redirect Base | youtubekids.com |
| Domain IPs | 2404:6800:4003:c0f::5b, 2404:6800:4003:c0f::5d, 2404:6800:4003:c0f::88, 2404:6800:4003:c0f::be, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93 |
| Redirect IPs | 142.251.175.136, 142.251.175.190, 142.251.175.91, 142.251.175.93, 2404:6800:4003:c00::5b, 2404:6800:4003:c00::88, 2404:6800:4003:c00::be, 2404:6800:4003:c05::5d, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93, 74.125.130.136, 74.125.130.91, 74.125.130.93, 74.125.24.91, 74.125.68.136, 74.125.68.190, 74.125.68.91, 74.125.68.93 |
| Response IP | 142.250.4.91 |
| Found | Yes |
| Hash | 42f30ed4041c4b4af314b940367055a6afe1848e02f15556dcd863fa2fc0bb24 |
| SimHash | 21820dc4ff92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /youtubei/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
Comments