justmarkets.com
robots.txt

Robots Exclusion Standard data for justmarkets.com

Resource Scan

Scan Details

Site Domain justmarkets.com
Base Domain justmarkets.com
Scan Status Ok
Last Scan2025-05-31T18:53:29+00:00
Next Scan 2025-06-07T18:53:29+00:00

Last Scan

Scanned2025-05-31T18:53:29+00:00
URL https://justmarkets.com/robots.txt
Domain IPs 172.66.40.150, 172.66.43.106, 2606:4700:3108::ac42:2896, 2606:4700:3108::ac42:2b6a
Response IP 172.66.43.106
Found Yes
Hash 46c9fe5e943a033cba9cca8bc1fb034730f408b77695538e5db05405f706088a
SimHash 4a7533e6a0f7

Groups

*

Rule Path
Allow */markets/indices/$
Allow */markets/forex/$
Allow */markets/crypto/$
Allow */markets/commodities/$
Allow */analytics/daily-forecast/$
Allow */analytics/market-overview/$
Disallow */markets/indices/*
Disallow */markets/forex/*
Disallow */markets/crypto/*
Disallow */markets/commodities/*
Disallow */analytics/daily-forecast/*
Disallow */analytics/market-overview-weekly/*
Disallow /login
Disallow /password_recovery
Disallow /back_office
Disallow /*uploads
Disallow */cgi-bin/
Disallow */wp-admin/
Disallow */wp-includes/
Disallow */wp-content/cache/
Disallow */wp-content/themes/
Disallow */category/*/*
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Disallow *legal-documents*
Disallow /*?ref
Disallow /*?cpa
Disallow /*?afm
Disallow /*n%3D
Disallow */public/css
Disallow */public/fonts
Disallow */public/js
Disallow */public/entrypoints.json
Disallow */public/manifest.json
Disallow /landing/

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Allow /

bingai

Rule Path
Allow /

Other Records

Field Value
sitemap https://justmarkets.com/sitemap-en.xml
sitemap https://justmarkets.com/sitemap-ar.xml
sitemap https://justmarkets.com/sitemap-pk.xml
sitemap https://justmarkets.com/sitemap-fr.xml
sitemap https://justmarkets.com/sitemap-es.xml
sitemap https://justmarkets.com/sitemap-pt.xml
sitemap https://justmarkets.com/sitemap-th.xml
sitemap https://justmarkets.com/sitemap-hi.xml
sitemap https://justmarkets.com/sitemap-bn.xml
sitemap https://justmarkets.com/sitemap-fa.xml
sitemap https://justmarkets.com/sitemap-ko.xml

Comments

  • Allow parent folders (with language subfolders considered)
  • Disallow subfolder contents under /markets/
  • Disallow subfolder contents under /analytics/
  • Basics
  • Sitemaps