10best.usatoday.com
robots.txt
Robots Exclusion Standard data for 10best.usatoday.com
Resource Scan
Scan Details
| Site Domain | 10best.usatoday.com |
| Base Domain | usatoday.com |
| Scan Status | Ok |
| Last Scan | 2024-04-25T15:57:58+00:00 |
| Next Scan | 2024-05-25T15:57:58+00:00 |
Last Scan
| Scanned | 2024-04-25T15:57:58+00:00 |
| URL | https://10best.usatoday.com/robots.txt |
| Domain IPs | 151.101.130.62, 151.101.194.62, 151.101.2.62, 151.101.66.62 |
| Response IP | 199.232.46.62 |
| Found | Yes |
| Hash | 00965791b2f9ca6199c5b7f8d8edbee7ec1e82b8675fbccf3893a4f4a781cbaa |
| SimHash | 51181840a573 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/iframe/ |
| Disallow | /legal/ |
| Disallow | /insider/ |
| Disallow | /status.html |
| Disallow | /awards/upload/ |
| Disallow | /awards/nominate/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.10best.com/sitemap.xml |
| sitemap | https://www.10best.com/sitemaps/sitemap-overview-and-cities-1.xml.gz |
| sitemap | https://www.10best.com/sitemaps/sitemap-articles-and-galleries-1.xml.gz |
| sitemap | https://www.10best.com/sitemaps/sitemap-restaurants-1.xml.gz |
| sitemap | https://www.10best.com/sitemaps/sitemap-hotels-1.xml.gz |
| sitemap | https://www.10best.com/sitemaps/sitemap-shopping-1.xml.gz |
| sitemap | https://www.10best.com/sitemaps/sitemap-nightlife-1.xml.gz |
| sitemap | https://www.10best.com/sitemaps/sitemap-attractions-1.xml.gz |