mthai.com
robots.txt
Robots Exclusion Standard data for mthai.com
Resource Scan
Scan Details
| Site Domain | mthai.com |
| Base Domain | mthai.com |
| Scan Status | Ok |
| Last Scan | 2024-06-23T21:10:02+00:00 |
| Next Scan | 2024-06-30T21:10:02+00:00 |
Last Scan
| Scanned | 2024-06-23T21:10:02+00:00 |
| URL | https://mthai.com/robots.txt |
| Domain IPs | 110.164.205.207, 2403:6200:7920:505::207 |
| Response IP | 110.164.205.207 |
| Found | Yes |
| Hash | ef59c51b91c5eb06016c398b88bd64bed20d5f4ba59c6433bea736248d8ed9ae |
| SimHash | 5b4db5ad8ff7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /page/* |
| Disallow | /?s=* |
| Allow | /lifestyle |
| Allow | /lifestyle/auto |
| Allow | /lifestyle/decor |
| Allow | /lifestyle/food |
| Allow | /lifestyle/health |
| Allow | /lifestyle/fashion |
| Allow | /news |
| Allow | /news/pr |
| Allow | /news/activity |
| Allow | /news/donate |
| Allow | /nft |
| Allow | /travel |
| Allow | /travel/* |
| Allow | /horoscope |
| Allow | /horoscope/yearly |
| Allow | /horoscope/daily |
| Allow | /horoscope/monthly |
| Allow | /horoscope/auspices |
| Allow | /horoscope/luckycolor |
| Allow | /monk |
| Allow | /rite |
| Allow | /rite/pray |
| Allow | /rite/chant |
| Allow | /sacred-object |
| Allow | /sacred-object/buddha-amulet |
| Allow | /sacred-object/amulet |
| Allow | /tag |
| Allow | /movie |
| Allow | /music |
| Allow | /entertainment |
| Allow | /privacy-policy |
| Allow | /cookies-pol |
| Allow | /contact-us |
| Allow | /about-us |
| Allow | /*.html/gallery |
| Disallow | /fatherday/?page=* |
| Disallow | /king/?page=* |
| Disallow | /king/?fbclid=* |
| Disallow | /*/*.html/%7B%7Burl%7D%7D |
| Disallow | /*.html/%7B%7Burl%7D%7D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://mthai.com/sitemap.xml |