wealthclub.co.uk
robots.txt

Robots Exclusion Standard data for wealthclub.co.uk

Resource Scan

Scan Details

Site Domain wealthclub.co.uk
Base Domain wealthclub.co.uk
Scan Status Ok
Last Scan2025-03-21T02:38:09+00:00
Next Scan 2025-04-20T02:38:09+00:00

Last Scan

Scanned2025-03-21T02:38:09+00:00
URL https://wealthclub.co.uk/robots.txt
Redirect https://www.wealthclub.co.uk/robots.txt
Redirect Domain www.wealthclub.co.uk
Redirect Base wealthclub.co.uk
Domain IPs 104.26.0.204, 104.26.1.204, 172.67.71.236, 2606:4700:20::681a:1cc, 2606:4700:20::681a:cc, 2606:4700:20::ac43:47ec
Redirect IPs 104.26.0.204, 104.26.1.204, 172.67.71.236, 2606:4700:20::681a:1cc, 2606:4700:20::681a:cc, 2606:4700:20::ac43:47ec
Response IP 172.67.71.236
Found Yes
Hash 66249600eadd23c1c1572851a80d704971a7a3430160064bb365703624422a75
SimHash bd1b5952e68a

Groups

*

Rule Path
Disallow *.pdf
Disallow /search/
Disallow /umbraco/
Disallow /download-document*

ahrefsbot
ahrefs site audit
barkrowler
botify
cxense
dataforseo
dataforseobot
jenkersbot
magpie-crawler
marketgoo
moodlebot
moz dotbot
moz rogerbot
omgili
omgilibot
online webceo bot
scrapy
se ranking bot
semrushbot
seo audit check bot
siteauditbot
siteimprove crawl
yacy
yandexmetrika
addthis

Rule Path
Disallow /

baidu
coccocbot-web
petalbot
seznambot
sogou
yandexbot
yandexvideo
yandexvideoparser
yeti by naver

Rule Path
Disallow /

anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
facebookbot
google-extended
gptbot
perplexitybot
yandexadditional
yandexadditionalbot
youbot

Rule Path
Disallow /

doc
download ninja
fast
fetch
grub-client
httrack
larbin
libwww
linko
microsoft.url.control
mj12bot
msiecrawler
npbot
offline explorer
sitesnagger
teleport
teleportpro
ubicrawler
webcopier
webreaper
webstripper
webzip
xenu
zao
zealbot
zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wealthclub.co.uk/sitemap.xml

Comments

  • Please do not edit this file
  • v1 20241104
  • ,___,
  • [0v0]
  • /)_)
  • /)__)
  • ^^| \
  • --"--"--
  • User-agent: AdsBot-Google
  • User-agent: AdsBot-Google-Mobile
  • Disallow: *.pdf
  • Disallow: /search/
  • do not want
  • overseas search
  • llm
  • naughty step
  • end