sharmax.com
robots.txt

Robots Exclusion Standard data for sharmax.com

Resource Scan

Scan Details

Site Domain sharmax.com
Base Domain sharmax.com
Scan Status Ok
Last Scan2025-09-18T00:54:04+00:00
Next Scan 2025-10-18T00:54:04+00:00

Last Scan

Scanned2025-09-18T00:54:04+00:00
URL https://sharmax.com/robots.txt
Domain IPs 104.26.0.126, 104.26.1.126, 172.67.74.114, 2606:4700:20::681a:17e, 2606:4700:20::681a:7e, 2606:4700:20::ac43:4a72
Response IP 104.26.1.126
Found Yes
Hash a7e8a16ec73cd59d31c820c88e0ad05e45b24f1e12e4b0f33dfd69cf2a6f581f
SimHash dc1dcac4d5b1

Groups

yandex

Rule Path
Disallow /*?*
Disallow /*/api/*
Disallow /*/comparison/*
Disallow /*/cart/*
Disallow /*/order/*
Disallow /ae_ar/*
Disallow /ru_ru/*
Disallow /br_pt/*
Disallow /qa_en/*
Disallow /sa_en/*
Disallow /co_es/*
Disallow /eg_en/*
Disallow /ma_fr/*
Disallow /ge_ka/*
Disallow /uz_uz/*

googlebot

Rule Path
Disallow /*?*
Disallow /*/api/*
Disallow /*/comparison/*
Disallow /*/cart/*
Disallow /*/order/*
Disallow /ae_ar/*
Disallow /ru_ru/*
Disallow /br_pt/*
Disallow /qa_en/*
Disallow /sa_en/*
Disallow /co_es/*
Disallow /eg_en/*
Disallow /ma_fr/*
Disallow /ge_ka/*
Disallow /uz_uz/*

*

Rule Path
Disallow /*?*
Disallow /*/api/*
Disallow /*/comparison/*
Disallow /*/cart/*
Disallow /*/order/*
Disallow /ae_ar/*
Disallow /ru_ru/*
Disallow /br_pt/*
Disallow /qa_en/*
Disallow /sa_en/*
Disallow /co_es/*
Disallow /eg_en/*
Disallow /ma_fr/*
Disallow /ge_ka/*
Disallow /uz_uz/*

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

gptbot
chatgpt-user
claude-web
anthropic-ai
applebot-extended
bytespider
ccbot
cohere-ai
diffbot
facebookbot
google-extended
imagesiftbot
perplexitybot
omigilibot
omigili

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sharmax.com/sitemap_index.xml

Comments

  • START nuxt-robots (indexable)
  • Block non helpful bots
  • Block AI Crawlers
  • END nuxt-robots