learnthai.pro
robots.txt

Robots Exclusion Standard data for learnthai.pro

Resource Scan

Scan Details

Site Domain learnthai.pro
Base Domain learnthai.pro
Scan Status Ok
Last Scan2024-05-27T10:59:02+00:00
Next Scan 2024-06-26T10:59:02+00:00

Last Scan

Scanned2024-05-27T10:59:02+00:00
URL https://learnthai.pro/robots.txt
Redirect https://rianthai.pro/robots.txt
Redirect Domain rianthai.pro
Redirect Base rianthai.pro
Domain IPs 104.21.80.37, 172.67.173.174, 2606:4700:3031::6815:5025, 2606:4700:3032::ac43:adae
Redirect IPs 104.21.42.111, 172.67.161.164, 2606:4700:3031::6815:2a6f, 2606:4700:3036::ac43:a1a4
Response IP 172.67.161.164
Found Yes
Hash feff10a6aaccd0382af9864dc6cb0c32490cc36be52e3290d14db58d6ed235c2
SimHash b02a8a04e217

Groups

*

Rule Path
Disallow /rd/
Disallow /ru/dictionary/search-results/
Disallow /en/dictionary/search-results/
Disallow /th/dictionary/search-results/
Disallow /th/books/
Disallow /th/taiskii-alfavit/
Disallow /th/taiskie-tsifry-chislitelnye/
Disallow /th/kursi-i-shkoli-taiskogo/
Disallow /static/books/russian/
Disallow /dictionary/
Disallow /ru/thai-english/words/
Disallow /en/thai-english/words/
Disallow /en/accounts/
Disallow /ru/accounts/
Disallow /th/accounts/

yandex

Rule Path
Disallow /th/dictionary/
Disallow /th/thai-english/words/
Disallow /rd/
Disallow /ru/dictionary/search-results/
Disallow /en/dictionary/search-results/
Disallow /th/dictionary/search-results/
Disallow /th/books/
Disallow /static/books/russian/
Disallow /dictionary/
Disallow /ru/thai-english/words/
Disallow /en/thai-english/words/
Disallow /en/accounts/
Disallow /ru/accounts/
Disallow /th/accounts/