knthost.com
robots.txt
Robots Exclusion Standard data for knthost.com
Resource Scan
Scan Details
Site Domain | knthost.com |
Base Domain | knthost.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-08-02T23:20:20+00:00 |
Next Scan | 2025-10-31T23:20:20+00:00 |
Last Successful Scan
Scanned | 2024-03-18T23:18:24+00:00 |
URL | https://knthost.com/robots.txt |
Redirect | https://www.knthost.com/robots.txt |
Redirect Domain | www.knthost.com |
Redirect Base | knthost.com |
Domain IPs | 45.13.66.100, 45.13.66.101, 45.13.66.102, 45.13.66.103 |
Redirect IPs | 45.13.66.100, 45.13.66.101, 45.13.66.102, 45.13.66.103 |
Response IP | 45.13.66.103 |
Found | Yes |
Hash | 1ef97ad7457000112081f49fc043ae51e0aae841628b5dcca949c577314458cd |
SimHash | 493cdd32e994 |
Groups
*
Rule | Path |
---|---|
Disallow | /.github/ |
Disallow | /.phan/ |
Disallow | /assets/ |
Disallow | /backup/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /logs/ |
Disallow | /system/ |
Disallow | /tests/ |
Disallow | /tmp/ |
Disallow | /user/ |
Disallow | /vendor/ |
Disallow | /webserver-configs/ |
Disallow | *.jpg |
Disallow | *.jpeg |
Disallow | *.webp |
Disallow | *.png |
Allow | /user/pages/ |
Allow | /user/themes/ |
Allow | /user/images/ |
Allow | / |
Allow | *.css$ |
Allow | *.js$ |
Allow | /system/*.js$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.knthost.com/sitemap.xml |
Comments