wishbone.io
robots.txt

Robots Exclusion Standard data for wishbone.io

Resource Scan

Scan Details

Site Domain wishbone.io
Base Domain wishbone.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-30T11:24:41+00:00
Next Scan 2024-08-28T11:24:41+00:00

Last Successful Scan

Scanned2023-11-03T08:01:27+00:00
URL https://www.wishbone.io/robots.txt
Domain IPs 3.232.158.56, 52.200.99.106, 54.210.91.94
Response IP 3.232.158.56
Found Yes
Hash 9c1e36e97589aa114a3dc2fa311db81f8fd580618446b97ed37a79ceee80b4e2
SimHash 6e4586315a26

Groups

*

Rule Path
Allow /.
Allow /
Disallow /c/*

googlebot-image

Rule Path
Allow /.
Allow /

adsbot-google

Rule Path
Allow /.
Allow /

bingbot

Rule Path
Allow /.
Allow /

googlebot-mobile

Rule Path
Allow /.
Allow /

mj12bot

Rule Path
Allow /.
Allow /

mj12bot

Rule Path
Allow /.
Allow /

abcdatos

Rule Path
Allow /.
Allow /

botlink

Rule Path
Allow /.
Allow /

acme.spider

Rule Path
Allow /.
Allow /

alkalinebot

Rule Path
Allow /.
Allow /

anthill

Rule Path
Allow /.
Allow /

appie/1.1

Rule Path
Allow /.
Allow /

arale

Rule Path
Allow /.
Allow /

architextspider

Rule Path
Allow /.
Allow /

ariadne

Rule Path
Allow /.
Allow /

arks/1.0

Rule Path
Allow /.
Allow /

mozilla/2.0

Rule Path
Allow /.
Allow /

askjeeves

Rule Path
Allow /.
Allow /

teoma

Rule Path
Allow /.
Allow /

aspider/0.09

Rule Path
Allow /.
Allow /

atn

Rule Path
Allow /.
Allow /

atomz

Rule Path
Allow /.
Allow /

backrub

Rule Path
Allow /.
Allow /

bayspider

Rule Path
Allow /.
Allow /

big brother

Rule Path
Allow /.
Allow /

bigbrother

Rule Path
Allow /.
Allow /

bjaaland

Rule Path
Allow /.
Allow /

blackwidow

Rule Path
Allow /.
Allow /

bloodhound

Rule Path
Allow /.
Allow /

borg-bot/0.9

Rule Path
Allow /.
Allow /

borg-bot

Rule Path
Allow /.
Allow /

boxseabot

Rule Path
Allow /.
Allow /

brightnet

Rule Path
Allow /.
Allow /

bspider

Rule Path
Allow /.
Allow /

cactvschemistryspider

Rule Path
Allow /.
Allow /

calif

Rule Path
Allow /.
Allow /

cassandra

Rule Path
Allow /.
Allow /

churl

Rule Path
Allow /.
Allow /

collective

Rule Path
Allow /.
Allow /

combine

Rule Path
Allow /.
Allow /

cosmos

Rule Path
Allow /.
Allow /

cruiser

Rule Path
Allow /.
Allow /

cyberspyder

Rule Path
Allow /.
Allow /

cyndralspider

Rule Path
Allow /.
Allow /

digger

Rule Path
Allow /.
Allow /

diibot

Rule Path
Allow /.
Allow /

directhit

Rule Path
Allow /.
Allow /

dnabot

Rule Path
Allow /.
Allow /

download_express

Rule Path
Allow /.
Allow /

dwcp

Rule Path
Allow /.
Allow /

googlebot

Rule Path
Disallow /c/*
Allow /.
Allow /

mindcrawler

Rule Path
Allow /.
Allow /

monster

Rule Path
Allow /.
Allow /

msnbot

Rule Path
Allow /.
Allow /

magpie

Rule Path
Allow /.
Allow /

lycos

Rule Path
Allow /.
Allow /

infoseek

Rule Path
Allow /.
Allow /

linkscan

Rule Path
Allow /.
Allow /

netscoop

Rule Path
Allow /.
Allow /

netmechanic

Rule Path
Allow /.
Allow /

pegasus

Rule Path
Allow /.
Allow /

pjspider

Rule Path
Allow /.
Allow /

roadrunner

Rule Path
Allow /.
Allow /

smartspider

Rule Path
Allow /.
Allow /

speedy

Rule Path
Allow /.
Allow /

spider_monkey

Rule Path
Allow /.
Allow /

spiderline

Rule Path
Allow /.
Allow /

spry

Rule Path
Allow /.
Allow /

titan

Rule Path
Allow /.
Allow /

voyager

Rule Path
Allow /.
Allow /

worm

Rule Path
Allow /.
Allow /

Other Records

Field Value
sitemap http://wishbone.io/sitemap.xml

Warnings

  • 3 invalid lines.