familyresearcher.co.uk
robots.txt

Robots Exclusion Standard data for familyresearcher.co.uk

Resource Scan

Scan Details

Site Domain familyresearcher.co.uk
Base Domain familyresearcher.co.uk
Scan Status Ok
Last Scan2024-07-02T15:34:55+00:00
Next Scan 2024-07-09T15:34:55+00:00

Last Scan

Scanned2024-07-02T15:34:55+00:00
URL https://familyresearcher.co.uk/robots.txt
Redirect https://www.familyresearcher.co.uk/robots.txt
Redirect Domain www.familyresearcher.co.uk
Redirect Base familyresearcher.co.uk
Domain IPs 217.160.0.225
Redirect IPs 217.160.223.123
Response IP 217.160.223.123
Found Yes
Hash 39d40cacc91154f079061a852a33178e20d7c4af022ac7afee9af4a5bf446123
SimHash d40c660035b2

Groups

findestars
myonid
peekyou
pipl
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo

Rule Path
Disallow /

*

Rule Path
Disallow /ThankYou.htm
Disallow /_IncludeFiles
Disallow /_Scripts
Disallow /__FamilyTreeBiz
Disallow /__RockHard
Disallow /__ArchiveSite

Comments

  • blocking people search engines
  • all other bots

Warnings

  • 1 invalid line.