phonesworld.us
robots.txt
Robots Exclusion Standard data for phonesworld.us
Resource Scan
Scan Details
| Site Domain | phonesworld.us |
| Base Domain | phonesworld.us |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-21T14:07:11+00:00 |
| Next Scan | 2024-11-19T14:07:11+00:00 |
Last Successful Scan
| Scanned | 2023-10-27T13:24:30+00:00 |
| URL | https://phonesworld.us/robots.txt |
| Domain IPs | 104.21.3.31, 172.67.130.38, 2606:4700:3033::ac43:8226, 2606:4700:3035::6815:31f |
| Response IP | 104.21.3.31 |
| Found | Yes |
| Hash | a17a3f9a55a88f8b811b32a4219f101b7ded8ab4f407585aafdd8cd548089b4c |
| SimHash | 66255741ed12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /comment |
| Disallow | /feeds/videos.xml |
| Disallow | /get_video |
| Disallow | /get_video_info |
| Disallow | /get_midroll_info |
| Disallow | /live_chat |
| Disallow | /login |
| Disallow | /qr |
| Disallow | /results |
| Disallow | /signup |
| Disallow | /t/terms |
| Disallow | /timedtext_video |
| Disallow | /verify_age |
| Disallow | /watch_ajax |
| Disallow | /watch_fragments_ajax |
| Disallow | /watch_popup |
| Disallow | /watch_queue_ajax |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.youtube.com/sitemaps/sitemap.xml |
| sitemap | https://www.youtube.com/product/sitemap.xml |
Comments