mohlondon.com
robots.txt

Robots Exclusion Standard data for mohlondon.com

Resource Scan

Scan Details

Site Domain mohlondon.com
Base Domain mohlondon.com
Scan Status Ok
Last Scan2026-01-08T03:28:57+00:00
Next Scan 2026-02-07T03:28:57+00:00

Last Scan

Scanned2026-01-08T03:28:57+00:00
URL https://mohlondon.com/robots.txt
Redirect https://www.mohlondon.com/robots.txt
Redirect Domain www.mohlondon.com
Redirect Base mohlondon.com
Domain IPs 77.68.77.214
Redirect IPs 77.68.77.214
Response IP 77.68.77.214
Found Yes
Hash c4e105ebd63cc2f9ef6075cf3e5a35fb6303572067d8a8f2b598cb18991fcc3e
SimHash 7844d55686bb

Groups

*

Rule Path
Disallow /admin/
Disallow /backoffice/
Disallow /customer/
Disallow /customer/*
Disallow /pub/
Disallow /*?page=
Disallow /*?p=
Disallow /*?sort=
Disallow /*?limit=
Disallow /*?orderby=
Disallow /*?groupby=
Disallow /*%26page%3D
Disallow /*%26sort%3D
Disallow /*%26limit%3D
Disallow /*%26orderby%3D
Disallow /*%26groupby%3D

googlebot-image

Rule Path
Disallow

domainstatsbot/1.0 (https://domainstats.com/pages/our-bot)

Rule Path
Disallow /

mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)

Rule Path
Disallow /

mozilla/5.0 (compatible; duckduckgo-favicons-bot/1.0; +http://duckduckgo.com)

Rule Path
Disallow /

mozilla/5.0 (compatible; startmebot/1.0; +https://start.me/bot)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

wget

Rule Path
Disallow /

httrack

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mohlondon.com/sitemap_category.xml
sitemap https://www.mohlondon.com/sitemap_product.xml
sitemap https://www.mohlondon.com/sitemap_fragrances_product.xml
sitemap https://www.mohlondon.com/sitemap_static.xml

Comments

  • Disallow internal and sensitive paths for all bots
  • Allow image indexing for Googlebot-Image
  • Disallow specific bots
  • Sitemap declarations here