learnthai.pro
robots.txt
Robots Exclusion Standard data for learnthai.pro
Resource Scan
Scan Details
Site Domain | learnthai.pro |
Base Domain | learnthai.pro |
Scan Status | Ok |
Last Scan | 2024-05-27T10:59:02+00:00 |
Next Scan | 2024-06-26T10:59:02+00:00 |
Last Scan
Scanned | 2024-05-27T10:59:02+00:00 |
URL | https://learnthai.pro/robots.txt |
Redirect | https://rianthai.pro/robots.txt |
Redirect Domain | rianthai.pro |
Redirect Base | rianthai.pro |
Domain IPs | 104.21.80.37, 172.67.173.174, 2606:4700:3031::6815:5025, 2606:4700:3032::ac43:adae |
Redirect IPs | 104.21.42.111, 172.67.161.164, 2606:4700:3031::6815:2a6f, 2606:4700:3036::ac43:a1a4 |
Response IP | 172.67.161.164 |
Found | Yes |
Hash | feff10a6aaccd0382af9864dc6cb0c32490cc36be52e3290d14db58d6ed235c2 |
SimHash | b02a8a04e217 |
Groups
*
Rule | Path |
---|---|
Disallow | /rd/ |
Disallow | /ru/dictionary/search-results/ |
Disallow | /en/dictionary/search-results/ |
Disallow | /th/dictionary/search-results/ |
Disallow | /th/books/ |
Disallow | /th/taiskii-alfavit/ |
Disallow | /th/taiskie-tsifry-chislitelnye/ |
Disallow | /th/kursi-i-shkoli-taiskogo/ |
Disallow | /static/books/russian/ |
Disallow | /dictionary/ |
Disallow | /ru/thai-english/words/ |
Disallow | /en/thai-english/words/ |
Disallow | /en/accounts/ |
Disallow | /ru/accounts/ |
Disallow | /th/accounts/ |
yandex
Rule | Path |
---|---|
Disallow | /th/dictionary/ |
Disallow | /th/thai-english/words/ |
Disallow | /rd/ |
Disallow | /ru/dictionary/search-results/ |
Disallow | /en/dictionary/search-results/ |
Disallow | /th/dictionary/search-results/ |
Disallow | /th/books/ |
Disallow | /static/books/russian/ |
Disallow | /dictionary/ |
Disallow | /ru/thai-english/words/ |
Disallow | /en/thai-english/words/ |
Disallow | /en/accounts/ |
Disallow | /ru/accounts/ |
Disallow | /th/accounts/ |