solpick.io
robots.txt

Robots Exclusion Standard data for solpick.io

Resource Scan

Scan Details

Site Domain solpick.io
Base Domain solpick.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-10T02:19:10+00:00
Next Scan 2025-04-11T02:19:10+00:00

Last Successful Scan

Scanned2024-11-20T01:32:20+00:00
URL https://solpick.io/robots.txt
Domain IPs 104.21.27.165, 172.67.169.144, 2606:4700:3032::ac43:a990, 2606:4700:3035::6815:1ba5
Response IP 172.67.169.144
Found Yes
Hash 382ba564088780d65304e4d915b810c5609a70e6b36e4346e756a21ee8ca78aa
SimHash 345e4a204b01

Groups

*

Rule Path
Disallow /

censys

Rule Path
Disallow /

shodan

Rule Path
Disallow /

zoomeye

Rule Path
Disallow /

binaryedge

Rule Path
Disallow /

netsystemsresearch

Rule Path
Disallow /

rapid7

Rule Path
Disallow /

fofa

Rule Path
Disallow /

onyphe

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

applebot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

site24x7

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

urleyebot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

veoozbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /