kstcasting.com
robots.txt
Robots Exclusion Standard data for kstcasting.com
Resource Scan
Scan Details
Site Domain | kstcasting.com |
Base Domain | kstcasting.com |
Scan Status | Ok |
Last Scan | 2024-11-09T20:56:38+00:00 |
Next Scan | 2024-12-09T20:56:38+00:00 |
Last Scan
Scanned | 2024-11-09T20:56:38+00:00 |
URL | https://kstcasting.com/robots.txt |
Redirect | https://www.kstcasting.com/robots.txt |
Redirect Domain | www.kstcasting.com |
Redirect Base | kstcasting.com |
Domain IPs | 137.220.32.20 |
Redirect IPs | 137.220.32.20 |
Response IP | 137.220.32.20 |
Found | Yes |
Hash | e80b633c0c9ce48d34b3914fdc51a5629c0a1b9955210bfdaa30f87ef3d6d8e7 |
SimHash | 5cc87040c5b1 |
Groups
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
Product | Comment |
---|---|
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm | 07) |
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /recommended/ |
Disallow | /vd/ |
Disallow | /controller* |
Disallow | /*?* |
Disallow | /index/getLanguage |
Disallow | /News/GetPro |
Disallow | /product-ajax/getStartOrderData |
Other Records
Field | Value |
---|---|
sitemap | https://www.kstcasting.com/sitemap.xml |
Warnings
- 2 invalid lines.
Comments