kaskus.tv
robots.txt
Robots Exclusion Standard data for kaskus.tv
Resource Scan
Scan Details
Site Domain | kaskus.tv |
Base Domain | kaskus.tv |
Scan Status | Ok |
Last Scan | 2024-06-22T12:07:04+00:00 |
Next Scan | 2024-06-29T12:07:04+00:00 |
Last Scan
Scanned | 2024-06-22T12:07:04+00:00 |
URL | http://kaskus.tv/robots.txt |
Redirect | https://www.kaskus.co.id/robots.txt |
Redirect Domain | www.kaskus.co.id |
Redirect Base | kaskus.co.id |
Domain IPs | 103.6.117.2, 103.6.117.3 |
Redirect IPs | 103.6.117.2, 103.6.117.3 |
Response IP | 103.6.117.3 |
Found | Yes |
Hash | ea704942ee070fa1f08e8aa0682851e3e18f638964c2822cdeb102dd62c09795 |
SimHash | f92acd792f1b |
Groups
*
Rule | Path |
---|---|
Allow | /thread/5d81ce60c8393a0dcb3e648f/*/$ |
Disallow | /thread/5d81ce60c8393a0dcb3e648f/*/* |
Disallow | /user/login |
Disallow | /user/login/ |
Disallow | /user/login/? |
Disallow | /user |
Disallow | /user/? |
Disallow | /post_reply |
Disallow | /post_reply/? |
Disallow | /embed/ |
Disallow | /gotothread |
Disallow | /gotothread/? |
Disallow | /lastpost |
Disallow | /lastpost/? |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.kaskus.co.id/sitemap.xml |
sitemap | https://www.kaskus.co.id/forum/sitemap.xml |
sitemap | https://www.kaskus.co.id/thread/sitemap.xml |
sitemap | https://www.kaskus.co.id/profile/sitemap.xml |
sitemap | https://www.kaskus.co.id/topic/sitemap.xml |