Log In Sign Up

go2joy.vn
robots.txt

Robots Exclusion Standard data for go2joy.vn

Resource Scan

Scan Details

Site Domain go2joy.vn
Base Domain go2joy.vn
Scan Status Ok
Last Scan2024-09-22T07:37:54+00:00
Next Scan 2024-09-29T07:37:54+00:00

Last Scan

Scanned2024-09-22T07:37:54+00:00
URL https://go2joy.vn/robots.txt
Domain IPs 52.221.95.190
Response IP 52.221.95.190
Found Yes
Hash 16b7028bcd2a90ada97006b916c946e455e54f215c2f630ed09a9ff7e48ee226
SimHash 1ae85242c46a

Groups

linkedinbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

coccocbot-web

Rule Path
Allow /

coccocbot

Rule Path
Allow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Allow /

semrushbot

Rule Path
Allow /

semrushbot-sa

Rule Path
Allow /

sistrix

Rule Path
Allow /

sistrix crawler

Rule Path
Allow /

sistrix

Rule Path
Allow /

seokicks-robot

Rule Path
Allow /

jobs.de-robot

Rule Path
Allow /

nutch

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

ahrefsbot/5.1

Rule Path
Allow

unisterbot

Rule Path
Allow /

dotbot

Rule Path
Allow /

searchmetricsbot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

surveybot

Rule Path
Allow /

seodiver

Rule Path
Allow /

spbot

Rule Path
Allow /

wotbox

Rule Path
Allow /

dotbot

Rule Path
Allow /

meanpathbot

Rule Path
Allow /

backlinkcrawler

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexmedia

Rule Path
Allow /

yandeximages

Rule Path
Allow /

magpie-crawler

Rule Path
Allow /

obot

Rule Path
Allow /

ezooms robot

Rule Path
Allow /

sogou spider

Rule Path
Allow /

fr-crawler

Rule Path
Allow /

blexbot

Rule Path
Allow /

blexbot/1.0

Rule Path
Allow /

megaindex.ru/2.0

Rule Path
Allow /

megaindex.ru

Rule Path
Allow /

cloudservermarketspider

Rule Path
Allow /

trendictionbot

Rule Path
Allow /

exabot

Rule Path
Allow /

careerbot

Rule Path
Allow /

lipperhey-kaus-australis

Rule Path
Allow /

seoscanners.net

Rule Path
Allow /

metajobbot

Rule Path
Allow /

spiderbot

Rule Path
Allow /

linkstats

Rule Path
Allow /

jobboersebot

Rule Path
Allow /

iccrawler

Rule Path
Allow /

plista

Rule Path
Allow /

domain re-animator bot

Rule Path
Allow /

lipperhey-kaus-australis

Rule Path
Allow /

turnitinbot

Rule Path
Allow /

um-ic

Rule Path
Allow /

mindupbot

Rule Path
Allow /

sg-orbiter

Rule Path
Allow /

ccbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

kraken

Rule Path
Allow /

plukkie

Rule Path
Allow /

safednsbot

Rule Path
Allow /

haosouspider

Rule Path
Allow /

rogerbot

Rule Path
Allow /

openhosebot

Rule Path
Allow /

thumbsniper

Rule Path
Allow /

r6_commentreader

Rule Path
Allow /

implisensebot

Rule Path
Allow /

cliqzbot

Rule Path
Allow /

aihitbot

Rule Path
Allow /

trendictionbot

Rule Path
Allow /

wbsearchbot

Rule Path
Allow /

*

Rule Path
Allow /*.js$
Allow /*.css$
Disallow /*/searchresults*
Disallow /*/promotionlist/*
Disallow /*/account/*
Disallow /*/booking/*
Back to top

Other Records

Field Value
sitemap https://go2joy.vn/sitemap.xml
Back to top

Comments

  • User-agent: Screaming Frog SEO Spider
  • Allow: /
Back to top

Warnings

  • 2 invalid lines.
Back to top