wefunkradio.com
robots.txt

Robots Exclusion Standard data for wefunkradio.com

Resource Scan

Scan Details

Site Domain wefunkradio.com
Base Domain wefunkradio.com
Scan Status Ok
Last Scan5/21/2025, 6:47:33 PM
Next Scan 6/20/2025, 6:47:33 PM

Last Scan

Scanned5/21/2025, 6:47:33 PM
URL https://wefunkradio.com/robots.txt
Redirect https://www.wefunkradio.com/robots.txt
Redirect Domain www.wefunkradio.com
Redirect Base wefunkradio.com
Domain IPs 192.99.152.99
Redirect IPs 192.99.152.99
Response IP 192.99.152.99
Found Yes
Hash 10ee3204d4a16e73463abc1ece764a89f913ca1dd21ccca097b4ff633957598d
SimHash fefd88a03413

Groups

shopwiki

Rule Path
Disallow /

*

Rule Path
Disallow /clickout
Disallow /addcomment
Disallow /addcomment.plx
Disallow /tellafriend
Disallow /tellafriend.plx
Disallow /prefs
Disallow /login
Disallow /logout

teleport

Rule Path
Disallow /

httrack

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

wx_mail/2.000

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

whowhere

Rule Path
Disallow /

roverbot

Rule Path
Disallow /

activeagent

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

asterias

Rule Path
Disallow /

Comments

  • all Disallow lines are path prefixes (no wildcards; should be no need for complete pathnames or filenames
  • E-Mail slurpers