olymptradewiki.com
robots.txt

Robots Exclusion Standard data for olymptradewiki.com

Resource Scan

Scan Details

Site Domain olymptradewiki.com
Base Domain olymptradewiki.com
Scan Status Ok
Last Scan2024-10-27T12:02:55+00:00
Next Scan 2024-11-26T12:02:55+00:00

Last Scan

Scanned2024-10-27T12:02:55+00:00
URL https://olymptradewiki.com/robots.txt
Domain IPs 104.21.64.177, 172.67.187.54, 2606:4700:3030::6815:40b1, 2606:4700:3034::ac43:bb36
Response IP 172.67.187.54
Found Yes
Hash 08e44e6cc36d346c86dbb564c796b9771c1a4e705fe3a30b9b0fb586789d9e65
SimHash 1077f7e26b39

Groups

barkrowler

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezlynx

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

majestic-12

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

lipperhey spider

Rule Path
Disallow /

spyfu

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

woorank

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /