justmary.com
robots.txt

Robots Exclusion Standard data for justmary.com

Resource Scan

Scan Details

Site Domain justmary.com
Base Domain justmary.com
Scan Status Ok
Last Scan2026-02-02T04:25:09+00:00
Next Scan 2026-02-16T04:25:09+00:00

Last Scan

Scanned2026-02-02T04:25:09+00:00
URL https://justmary.com/robots.txt
Domain IPs 23.227.38.36, 2620:127:f00f:4::
Response IP 23.227.38.36
Found Yes
Hash f24eb0b98084cf8185f3dbac594c9fbf9afc54411280494eb4e3485fbb4290ee
SimHash 6094c846d6b3

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /
Allow /checkout
Allow /checkouts

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /account
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /*?*sort_by=
Disallow /*?*filter.v.*
Disallow /*?*price=
Disallow /*?*variant=
Disallow /*?q=*
Disallow /*?pr_prod_strat=*
Disallow /*?pr_rec_id=*
Disallow /*?_pos=*
Disallow /*?_sid=*
Disallow /*?_ss=*
Disallow /*?_v=*
Disallow /fr/*
Disallow /es/*
Disallow /de/*

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://justmary.com/sitemap.xml

Comments

  • --- GOOGLEBOT PRIORITIES (For Merchant Center & Ads) ---
  • --- GENERAL BOT RULES ---
  • --- JUSTMARY SEO SHIELD (Clean up) ---
  • --- BLOCKING OLD LANGUAGES ---
  • --- CRAWL DELAY FOR HEAVY BOTS ---