darktorrent.org
robots.txt

Robots Exclusion Standard data for darktorrent.org

Resource Scan

Scan Details

Site Domain darktorrent.org
Base Domain darktorrent.org
Scan Status Ok
Last Scan2024-11-04T22:25:50+00:00
Next Scan 2024-11-11T22:25:50+00:00

Last Scan

Scanned2024-11-04T22:25:50+00:00
URL https://darktorrent.org/robots.txt
Domain IPs 104.21.5.236, 172.67.154.193, 2606:4700:3036::ac43:9ac1, 2606:4700:3037::6815:5ec
Response IP 104.21.5.236
Found Yes
Hash d479d6805176ed91c986942113ad052686374a84e1cd0ea2813a3cffc152915f
SimHash 690da0fa8131

Groups

*

Rule Path
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /user/
Disallow /tags/
Disallow /*/tags/
Disallow /backup/
Disallow /cache/
Disallow /catalog/
Disallow /lastnews/
Disallow /language/
Disallow /newposts/
Disallow /favorites/
Disallow /xfsearch/
Disallow /statistics.html
Disallow /rules.html
Disallow /rss.xml
Disallow /index.php?action=mobile
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*print
Disallow /*do%3Ddownload
Disallow /*do%3Dgo
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/

Other Records

Field Value
sitemap https://darktorrent.org/sitemap.xml