thoidai.com.vn
robots.txt
Robots Exclusion Standard data for thoidai.com.vn
Resource Scan
Scan Details
| Site Domain | thoidai.com.vn |
| Base Domain | thoidai.com.vn |
| Scan Status | Ok |
| Last Scan | 2024-11-13T19:24:57+00:00 |
| Next Scan | 2024-11-20T19:24:57+00:00 |
Last Scan
| Scanned | 2024-11-13T19:24:57+00:00 |
| URL | https://thoidai.com.vn/robots.txt |
| Domain IPs | 103.74.121.168 |
| Response IP | 103.74.121.168 |
| Found | Yes |
| Hash | f24a69c5075bad86d41f2b7fe2bbba0a6f23eec6b8e061e126df5118f6b27548 |
| SimHash | 816cfe64ab34 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /stats/ |
| Disallow | /member.api/ |
| Disallow | /apiservice%40/ |
| Disallow | /widgets%40/ |
| Disallow | /tag/ |
| Disallow | /slie/ |
| Disallow | /widgets%40/ |
| Disallow | /login/ |
| Disallow | /article/ |
| Disallow | /login/ |
| Disallow | /administrator/ |
| Disallow | /*.pdf$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.doc$ |
| Disallow | /*.docx$ |
| Disallow | /act/ |
| Disallow | /adsfw/ |
| Disallow | /preview_article/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thoidai.com.vn/sitemap.xml |
| sitemap | https://thoidai.com.vn/newssitemap.xml |