topfiles.download
robots.txt

Robots Exclusion Standard data for topfiles.download

Resource Scan

Scan Details

Site Domain topfiles.download
Base Domain topfiles.download
Scan Status Ok
Last Scan2024-10-16T00:03:11+00:00
Next Scan 2024-11-15T00:03:11+00:00

Last Scan

Scanned2024-10-16T00:03:11+00:00
URL https://topfiles.download/robots.txt
Redirect https://russ.topfiles.download/robots.txt
Redirect Domain russ.topfiles.download
Redirect Base topfiles.download
Domain IPs 104.21.8.210, 172.67.130.174, 2606:4700:3034::6815:8d2, 2606:4700:3036::ac43:82ae
Redirect IPs 104.21.8.210, 172.67.130.174, 2606:4700:3034::6815:8d2, 2606:4700:3036::ac43:82ae
Response IP 104.21.8.210
Found Yes
Hash 64691488ad71c3affe5bbbf98bc19467e1b07f6a5cc0209691d9e05f3c2b9da7
SimHash fd097170f137

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /go/
Disallow /not-found/
Disallow /load.php
Disallow /go.php