Log In Sign Up

darknet.tw
robots.txt

Robots Exclusion Standard data for darknet.tw

Resource Scan

Scan Details

Site Domain darknet.tw
Base Domain darknet.tw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-07T01:12:04+00:00
Next Scan 2025-10-05T01:12:04+00:00

Last Successful Scan

Scanned2023-02-26T00:22:50+00:00
URL https://darknet.tw/robots.txt
Domain IPs 104.21.1.212, 172.67.152.87, 2606:4700:3037::6815:1d4, 2606:4700:3037::ac43:9857
Response IP 104.21.1.212
Found Yes
Hash 6e418f16355625c8af871570720bb629b16f310b81c7283ffa2fc51ec41938ad
SimHash 74311d948318

Groups

*

Rule Path
Allow /*?app=core&module=search&do=active&search_app=forums
Disallow /user/
Disallow /admin/
Disallow /cache/
Disallow /converge_local/
Disallow /hooks/
Disallow /ips_kernel/
Disallow /retail/
Disallow /public/style_captcha/
Disallow /index.php?app=core&module=task
Disallow /index.php?app=forums&module=moderate&section=moderate
Disallow /index.php?app=forums&module=extras&section=forward
Disallow /index.php?app=members&module=messaging
Disallow /index.php?app=members&module=chat
Disallow /index.php?app=members&module=search
Disallow /index.php?app=members&module=search&do=active
Disallow /index.php?&unlockUserAgent=1
Disallow /*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /*app%3Dcore%26module%3Dusercp
Disallow /*app%3Dcore%26amp%3Bmodule%3Dusercp
Disallow /*app%3Dmembers%26module%3Dmessaging
Disallow /*%26p%3D
Disallow /*%26pid%3D
Disallow /*%26hl%3D
Disallow /*%26start%3D
Disallow /*view__getnewpost$
Disallow /*view__getlastpost$
Disallow /*view__old$
Disallow /*view__new$
Disallow /*view__getfirst$
Disallow /*view__getprevious$
Disallow /*view__getnext$
Disallow /*view__getlast$
Disallow /*%26view%3Dgetnewpost$
Disallow /*%26view%3Dgetlastpost$
Disallow /*%26view%3Dold$
Disallow /*%26view%3Dnew$
Disallow /*%26view%3Dgetfirst$
Disallow /*%26view%3Dgetprevious$
Disallow /*%26view%3Dgetnext$
Disallow /*%26view%3Dgetlast$
Disallow /*?s=
Disallow /*%26s%3D
Disallow /index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /index.php?app=forums&module=extras&section=rating
Disallow /index.php?app=forums&module=forums&section=markasread
Disallow /*%26do%3Dwho
Disallow /*%26section%3Ddname
Back to top

Other Records

Field Value
sitemap http://darknet.tw/sitemap.php
Back to top