Log In Sign Up

ly.gov.tw
robots.txt

Robots Exclusion Standard data for ly.gov.tw

Resource Scan

Scan Details

Site Domain ly.gov.tw
Base Domain ly.gov.tw
Scan Status Ok
Last Scan2024-10-24T02:34:06+00:00
Next Scan 2024-11-23T02:34:06+00:00

Last Scan

Scanned2024-10-24T02:34:06+00:00
URL https://www.ly.gov.tw/robots.txt
Domain IPs 168.95.245.1, 168.95.245.2, 168.95.245.3, 168.95.245.4, 168.95.246.1, 168.95.246.2, 168.95.246.3, 168.95.246.4, 2001:b000:590::1, 2001:b000:590::2, 2001:b000:590::3, 2001:b000:590::4, 2001:b000:591::1, 2001:b000:591::2, 2001:b000:591::3, 2001:b000:591::4
Response IP 168.95.245.1
Found Yes
Hash e1fa5946a6310ab7ef0578a67dd7352a74cb3c2e2f3d58061d8b73d3d42e6f96
SimHash 7b043253d1f5

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

appengine-google

Rule Path
Disallow /

archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

archiver/3.1.1++http://www.archive.org/details/archive.org_bot

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

bublupbot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

crowdtanglebot

Rule Path
Disallow /

chrome

Rule Path
Disallow /

crawler

Rule Path
Disallow /

crawler

Rule Path
Disallow /

com/bot

Rule Path
Disallow /

coibotparser

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

df+bot

Rule Path
Disallow /

dropboxpreviewbot

Rule Path
Disallow /

datagnionbot

Rule Path
Disallow /

digitalshadowsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gettmdeadref500v11 pywikibot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

googleplusbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

gentle+bot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

headerinspector+bot

Rule Path
Disallow /

internetarchive

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

lightspeedsystemscrawler

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

mediawords bot

Rule Path
Disallow /

mediawords+bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

net/bot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

other

Rule Path
Disallow /

outclicksbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

plurkbot

Rule Path
Disallow /

ptt-bot

Rule Path
Disallow /

pingbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

pywikibot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

politecrawl

Rule Path
Disallow /

pywebcopybot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

redditbot

Rule Path
Disallow /

robot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

slackbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

spider

Rule Path
Disallow /

slurp

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

safari

Rule Path
Disallow /

sitecheck-sitecrawl

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

trendictionbot0

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

tigerbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

whatsapp

Rule Path
Disallow /

web-crawler

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

y!j-brw

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yandexturbo

Rule Path
Disallow /

yioopbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

archivebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blogbridge

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

bot

Rule Path
Disallow /

brands-bot

Rule Path
Disallow /

clarabot

Rule Path
Disallow /

combot

Rule Path
Disallow /

doc/botinfo

Rule Path
Disallow /

doximity-diffbot

Rule Path
Disallow /

echoboxbot

Rule Path
Disallow /

finditanswersbot

Rule Path
Disallow /

java

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mazbot

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

monsidobot

Rule Path
Disallow /

multiscraper

Rule Path
Disallow /

newsgatoronline

Rule Path
Disallow /

ninja+bot

Rule Path
Disallow /

onalyticabot

Rule Path
Disallow /

onespot-scraperbot

Rule Path
Disallow /

redirectbot

Rule Path
Disallow /

refindbot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

scribbr-citation-bot

Rule Path
Disallow /

snappreviewbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

sitecheckerbotcrawler

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

archiver/3.1.1++http://www.archive.org/details/archive.org_bot

Rule Path
Disallow /

mediacloud+bot

Rule Path
Disallow /

obot

Rule Path
Disallow /

quora-bot

Rule Path
Disallow /

superbot

Rule Path
Disallow /

sitecheckerbot

Rule Path
Disallow /

node-spider

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

bananabot

Rule Path
Disallow /

accompanybot

Rule Path
Disallow /

fastcrawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bokaibokai-crawler

Rule Path
Disallow /

rustbot

Rule Path
Disallow /

komodiabot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

crawlson

Rule Path
Disallow /
Back to top