sexy-torrents.com
robots.txt

Robots Exclusion Standard data for sexy-torrents.com

Resource Scan

Scan Details

Site Domain sexy-torrents.com
Base Domain sexy-torrents.com
Scan Status Ok
Last Scan2025-03-14T11:17:27+00:00
Next Scan 2025-04-13T11:17:27+00:00

Last Scan

Scanned2025-03-14T11:17:27+00:00
URL https://sexy-torrents.com/robots.txt
Redirect https://sexy-torrents.ru/robots.txt
Redirect Domain sexy-torrents.ru
Redirect Base sexy-torrents.ru
Domain IPs 104.21.80.205, 172.67.153.145, 2606:4700:3034::ac43:9991, 2606:4700:3035::6815:50cd
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.64.1
Found Yes
Hash ae4363dafb54fba98b7f2f0937857dc31b6db69e99e5d8c1ed50be89e68ff34f
SimHash fd0d8d788133

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/img.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm

Other Records

Field Value
sitemap http://sexy-torrents.ru/sitemap.xml

Warnings

  • `host` is not a known field.