thaiexaminer.com
robots.txt
Robots Exclusion Standard data for thaiexaminer.com
Resource Scan
Scan Details
Site Domain | thaiexaminer.com |
Base Domain | thaiexaminer.com |
Scan Status | Ok |
Last Scan | 2024-11-09T10:36:04+00:00 |
Next Scan | 2024-11-16T10:36:04+00:00 |
Last Scan
Scanned | 2024-11-09T10:36:04+00:00 |
URL | https://thaiexaminer.com/robots.txt |
Redirect | https://www.thaiexaminer.com/robots.txt |
Redirect Domain | www.thaiexaminer.com |
Redirect Base | thaiexaminer.com |
Domain IPs | 104.129.17.75 |
Redirect IPs | 104.129.17.75 |
Response IP | 104.129.17.75 |
Found | Yes |
Hash | d68931250742ed8542722268efc1e4a6879e584bfe66c389f331a31377d03f5e |
SimHash | 68409f2069d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /thailand-news-forums/ |
Disallow | /forums/ |
Disallow | /ad-specials/ |
Disallow | /capitol-fm/ |