topshareware.com
robots.txt

Robots Exclusion Standard data for topshareware.com

Resource Scan

Scan Details

Site Domain topshareware.com
Base Domain topshareware.com
Scan Status Ok
Last Scan6/5/2025, 4:06:38 AM
Next Scan 6/12/2025, 4:06:38 AM

Last Scan

Scanned6/5/2025, 4:06:38 AM
URL https://topshareware.com/robots.txt
Redirect https://www.topshareware.com/robots.txt
Redirect Domain www.topshareware.com
Redirect Base topshareware.com
Domain IPs 104.21.72.92, 172.67.179.118, 2606:4700:3031::6815:485c, 2606:4700:3037::ac43:b376
Redirect IPs 104.21.72.92, 172.67.179.118, 2606:4700:3031::6815:485c, 2606:4700:3037::ac43:b376
Response IP 104.21.72.92
Found Yes
Hash bfa4a3ab1fda0a20f2b807b1cab57a787972e21273e645e6eecbb288df731767
SimHash 995d9a05cf41

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /redirect.aspx
Disallow /downloads.aspx
Disallow /download.aspx
Disallow /buy.aspx
Disallow /search.aspx
Disallow /*?

digout4u

Rule Path
Disallow /

discofinder

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

e-collector

Rule Path
Disallow /

eirgrabber

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

getwebpage

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

pagedown

Rule Path
Disallow /

sitemapper

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

superbot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

web2map

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webdupe

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webfetcher

Rule Path
Disallow /

webfountain

Rule Path
Disallow /

webhook

Rule Path
Disallow /

web image

Rule Path
Disallow /

webminer

Rule Path
Disallow /

webmirror

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webster

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web sucker

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

website extractor

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

wget/1.6

Rule Path
Disallow /

wget/1.5.3

Rule Path
Disallow /

xaldon webspider

Rule Path
Disallow /