tab.uol.com.br
robots.txt
Robots Exclusion Standard data for tab.uol.com.br
Resource Scan
Scan Details
| Site Domain | tab.uol.com.br |
| Base Domain | uol.com.br |
| Scan Status | Ok |
| Last Scan | 2024-10-18T17:08:02+00:00 |
| Next Scan | 2024-11-01T17:08:02+00:00 |
Last Scan
| Scanned | 2024-10-18T17:08:02+00:00 |
| URL | https://tab.uol.com.br/robots.txt |
| Domain IPs | 184.87.193.134, 184.87.193.136, 2600:1413:b000:1e::17d1:2e48, 2600:1413:b000:1e::17d1:2e5a |
| Response IP | 23.45.207.172 |
| Found | Yes |
| Hash | 86335ed1de0508b25ad103f6ae72d3f44667d07848ecf6446e7f61f0428c358f |
| SimHash | 602c99604113 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dev/ |
| Disallow | /enquetes/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://tab.uol.com.br/sitemap.xml |
| sitemap | https://tab.uol.com.br/sitemap/news-01.xml |