sthi.com
robots.txt
Robots Exclusion Standard data for sthi.com
Resource Scan
Scan Details
Site Domain | sthi.com |
Base Domain | sthi.com |
Scan Status | Ok |
Last Scan | 2025-09-01T17:54:11+00:00 |
Next Scan | 2025-10-01T17:54:11+00:00 |
Last Scan
Scanned | 2025-09-01T17:54:11+00:00 |
URL | https://www.sthi.com/robots.txt |
Domain IPs | 104.20.20.61, 172.66.157.1, 2606:4700:10::6814:143d, 2606:4700:10::ac42:9d01 |
Response IP | 172.66.157.1 |
Found | Yes |
Hash | b77c7d3150960e3a70e8dffa576fbb04d6cd49ae54710708b82ac63236b315fd |
SimHash | c354d874ef01 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /apps/ |
Disallow | /labs.html |
Disallow | /1/ |
Disallow | /labs/ |
Disallow | /labs |
Other Records
Field | Value |
---|---|
sitemap | https://www.sthi.com/sitemap.xml |