rwz-trader.com
robots.txt

Robots Exclusion Standard data for rwz-trader.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	rwz-trader.com
Base Domain	rwz-trader.com
Scan Status	Ok
Last Scan	2025-11-17T10:13:07+00:00
Next Scan	2025-11-24T10:13:07+00:00

Last Scan

Scanned	2025-11-17T10:13:07+00:00
URL	https://www.rwz-trader.com/robots.txt
Domain IPs	52.29.61.138
Response IP	52.29.61.138
Found	Yes
Hash	59057fa8ed4a745a6e38dd0cb3fe639a01a4559b9148faac66e0acc954f44d93
SimHash	523ceb60ee08

Groups

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

baidubot

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider-mobile

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider-video

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

cazoodlebot

Rule	Path
Disallow	/

Rule

Path

Disallow

coccoc

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

genieo

Rule	Path
Disallow	/

Rule

Path

Disallow

getintentcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

gigablastopensource

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshotcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

grub-client

Rule	Path
Disallow	/

Rule

Path

Disallow

implisensebot

Rule	Path
Disallow	/

Rule

Path

Disallow

jikespider

Rule	Path
Disallow	/

Rule

Path

Disallow

lb-spider

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mojeekbot

Rule	Path
Disallow	/

Rule

Path

Disallow

nerdybot

Rule	Path
Disallow	/

Rule

Path

Disallow

npbot

Rule	Path
Disallow	/

Rule

Path

Disallow

openlinkprofiler

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

telegrambot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou inst spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider2

Rule	Path
Disallow	/

Rule

Path

Disallow

webreaper

Rule	Path
Disallow	/

Rule

Path

Disallow

wozukaufenbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

adidxbot

Rule	Path
Disallow	/

Rule

Path

Disallow

storebot-google

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-web

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-user

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-searchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

Warnings

2 invalid lines.

rwz-trader.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

ahrefsbot

baidubot

baiduspider

baiduspider-mobile

baiduspider-video

blexbot

cazoodlebot

coccoc

dotbot

genieo

getintentcrawler

gigablastopensource

grapeshotcrawler

grub-client

implisensebot

jikespider

lb-spider

lipperhey

mj12bot

mojeekbot

nerdybot

npbot

openlinkprofiler

proximic

telegrambot

semrushbot

seokicks-robot

seznambot

sogou web spider

sogou inst spider

sogou spider2

webreaper

wozukaufenbot

yandexbot

amazonbot

adidxbot

storebot-google

gptbot

chatgpt-user

ccbot

perplexitybot

anthropic-ai

claude-web

claudebot

claude-user

claude-searchbot

Warnings

rwz-trader.com
robots.txt