Log In Sign Up

solana-markets.com
robots.txt

Robots Exclusion Standard data for solana-markets.com

Resource Scan

Scan Details

Site Domain solana-markets.com
Base Domain solana-markets.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-19T10:36:47+00:00
Next Scan 2024-12-18T10:36:47+00:00

Last Successful Scan

Scanned2023-11-02T04:12:06+00:00
URL https://solana-markets.com/robots.txt
Domain IPs 104.21.17.122, 172.67.176.191, 2606:4700:3031::ac43:b0bf, 2606:4700:3032::6815:117a
Response IP 104.21.17.122
Found Yes
Hash fa5bc4c2062ea1f55df877fd2676ae3b513b52fd3b99b22055699ec17624b84f
SimHash 0d1159a4f090

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

slurp

Rule Path
Allow /

apis-google

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google-mobile-apps

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

duplexweb-google

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

yandexadnet

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexfordomain

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexontodbapi

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

yandexsitelinks

Rule Path
Disallow /

yandexspravbot

Rule Path
Disallow /

yandexturbo

Rule Path
Disallow /

yandexvertis

Rule Path
Disallow /

yandexverticals

Rule Path
Disallow /

yandexvideo

Rule Path
Disallow /

yandexwebmaster

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

scrapebox

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top