morjas.com
robots.txt

Robots Exclusion Standard data for morjas.com

Resource Scan

Scan Details

Site Domain morjas.com
Base Domain morjas.com
Scan Status Ok
Last Scan2025-04-06T17:55:03+00:00
Next Scan 2025-05-06T17:55:03+00:00

Last Scan

Scanned2025-04-06T17:55:03+00:00
URL https://morjas.com/robots.txt
Redirect https://www.morjas.com/robots.txt
Redirect Domain www.morjas.com
Redirect Base morjas.com
Domain IPs 104.26.8.85, 104.26.9.85, 172.67.69.37, 2606:4700:20::681a:855, 2606:4700:20::681a:955, 2606:4700:20::ac43:4525
Redirect IPs 104.26.8.85, 104.26.9.85, 172.67.69.37, 2606:4700:20::681a:855, 2606:4700:20::681a:955, 2606:4700:20::ac43:4525
Response IP 104.26.9.85
Found Yes
Hash 8f54d87d198e1e45cd294341a92fa59f055e8b4ad78658f96e466048fddb4c39
SimHash a0507ee2d932

Groups

*

Rule Path
Disallow /selection
Disallow /selection/*
Disallow /checkout
Disallow /checkout/*
Disallow /search
Disallow /search/*
Disallow /*?yoReviewsPage
Disallow /ch/en/
Disallow /ch/fr/
Disallow /de/en/
Disallow /de/fr/
Disallow /de/de/
Disallow /fr/de/
Disallow /fr/en/
Disallow /fr/fr/
Disallow /eu/fr/
Disallow /eu/de/
Disallow /row/fr/
Disallow /row/de/
Disallow /dk/fr/
Disallow /dk/de/
Disallow /se/fr/
Disallow /se/de/
Disallow /nl/fr/
Disallow /nl/de/
Disallow /no/fr/
Disallow /no/de/
Disallow /uk/fr/
Disallow /uk/de/
Disallow /us/fr/
Disallow /us/de/
Disallow /fr/de/
Disallow /fr/eu/
Disallow /fr/se/
Disallow /fr/uk/
Disallow /fr/us/
Disallow /fr/dk/
Disallow /fr/no/
Disallow /fr/nl/
Disallow /fr/row/
Disallow /de/fr/
Disallow /de/eu/
Disallow /de/se/
Disallow /de/uk/
Disallow /de/us/
Disallow /de/dk/
Disallow /de/no/
Disallow /de/nl/
Disallow /de/row/
Disallow /eu/fr/
Disallow /eu/de/
Disallow /eu/se/
Disallow /eu/uk/
Disallow /eu/us/
Disallow /eu/dk/
Disallow /eu/no/
Disallow /eu/nl/
Disallow /eu/row/
Disallow /se/fr/
Disallow /se/de/
Disallow /se/eu/
Disallow /se/uk/
Disallow /se/us/
Disallow /se/dk/
Disallow /se/no/
Disallow /se/nl/
Disallow /se/row/
Disallow /uk/fr/
Disallow /uk/de/
Disallow /uk/eu/
Disallow /uk/se/
Disallow /uk/us/
Disallow /uk/dk/
Disallow /uk/no/
Disallow /uk/nl/
Disallow /uk/row/
Disallow /us/fr/
Disallow /us/de/
Disallow /us/eu/
Disallow /us/se/
Disallow /us/uk/
Disallow /us/dk/
Disallow /us/no/
Disallow /us/nl/
Disallow /us/row/
Disallow /dk/fr/
Disallow /dk/de/
Disallow /dk/eu/
Disallow /dk/se/
Disallow /dk/uk/
Disallow /dk/us/
Disallow /dk/no/
Disallow /dk/nl/
Disallow /dk/row/
Disallow /no/fr/
Disallow /no/de/
Disallow /no/eu/
Disallow /no/se/
Disallow /no/uk/
Disallow /no/us/
Disallow /no/dk/
Disallow /no/nl/
Disallow /no/row/
Disallow /nl/fr/
Disallow /nl/de/
Disallow /nl/eu/
Disallow /nl/se/
Disallow /nl/uk/
Disallow /nl/us/
Disallow /nl/dk/
Disallow /nl/no/
Disallow /nl/row/
Disallow /row/fr/
Disallow /row/de/
Disallow /row/eu/
Disallow /row/se/
Disallow /row/uk/
Disallow /row/us/
Disallow /row/dk/
Disallow /row/no/
Disallow /row/nl/

adsbot-google

Rule Path
Disallow /selection
Disallow /selection/*
Disallow /checkout
Disallow /checkout/*

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

nutch

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

alligator

Rule Path
Disallow /

sq webscanner

Rule Path
Disallow /

allsubmitter

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

anonymous

Rule Path
Disallow /

asterias

Rule Path
Disallow /

autoemailspider

Rule Path
Disallow /

badass

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

bitacle

Rule Path
Disallow /

dragonfly

Rule Path
Disallow /

dreampassport

Rule Path
Disallow /

dsurf

Rule Path
Disallow /

ebrowse

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

edgeio

Rule Path
Disallow /

dreampassport

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

fsurf

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

gamespy_arcade

Rule Path
Disallow /

geniebot

Rule Path
Disallow /

getbot

Rule Path
Disallow /

getright

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

go!zilla

Rule Path
Disallow /

go-ahead-got-it

Rule Path
Disallow /

goforitbot

Rule Path
Disallow /

email extractor

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

jeteye

Rule Path
Disallow /

jeteyebot

Rule Path
Disallow /

jobo

Rule Path
Disallow /

joc web spider

Rule Path
Disallow /

kapere

Rule Path
Disallow /

larbin

Rule Path
Disallow /

leechget

Rule Path
Disallow /

lightningdownload

Rule Path
Disallow /

linkie

Rule Path
Disallow /

mac finder

Rule Path
Disallow /

mail sweeper

Rule Path
Disallow /

outfoxbot

Rule Path
Disallow /

omniexplorer

Rule Path
Disallow /

p3p

Rule Path
Disallow /

psycheclone

Rule Path
Disallow /

puf

Rule Path
Disallow /

pussycat

Rule Path
Disallow /

puxarapido

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

realdownload

Rule Path
Disallow /

redkernel

Rule Path
Disallow /

relevantnoise

Rule Path
Disallow /

y!tunnelpro

Rule Path
Disallow /

yahooysmcm

Rule Path
Disallow /

zade

Rule Path
Disallow /

zbot

Rule Path
Disallow /

zerxbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.morjas.com/sitemaps/index.xml

Comments

  • none default language
  • double markets
  • Google Adsbot ignores robots.txt unless specifically named
  • Slow down some bots
  • Disallow bad bots