Log In Sign Up

mgmotor.bg
robots.txt

Robots Exclusion Standard data for mgmotor.bg

Resource Scan

Scan Details

Site Domain mgmotor.bg
Base Domain mgmotor.bg
Scan Status Ok
Last Scan2026-03-24T00:56:04+00:00
Next Scan 2026-04-23T00:56:04+00:00

Last Scan

Scanned2026-03-24T00:56:04+00:00
URL https://mgmotor.bg/robots.txt
Redirect https://www.mgmotor.bg:443/robots.txt
Redirect Domain www.mgmotor.bg
Redirect Base mgmotor.bg
Domain IPs 76.223.67.205
Redirect IPs 13.248.203.41, 76.223.67.205
Response IP 76.223.67.205
Found Yes
Hash 16349ce7c46186158d08312c64cb9bd1dc50d48b9d922ba91eef6a994fda3e84
SimHash 4232d95a2e9a

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claude-web

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

ccbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

facebookbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

amazonbot

Rule Path
Allow /

diffbot

Rule Path
Allow /

omgili

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.mgmotor.eu/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/nl-NL/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/nn-NO/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/de-AT/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.be/fr/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.be/nl/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.de/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.lu/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.fr/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/is-IS/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/sv-SE/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.it/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/es-ES/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/pt-PT/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.eu/fi-FI/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.ch/it/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.ch/fr/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.ch/de/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.hu/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.lt/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.bg/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.bg/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.pl/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.ee/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.lv/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.hr/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.si/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.ba/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.rs/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.bg/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.mk/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.al/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.gr/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.bg/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.bg/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.bg/sitemaps-1-sitemap.xml
sitemap https://www.mgmotor.bg/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.mgmotor.bg/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Allow ChatGPT bot
  • Allow Google Gemini (Bard)
  • Allow Perplexity bot
  • OpenAI (ChatGPT, GPT models)
  • Anthropic (Claude)
  • Google (Gemini, Bard)
  • Perplexity AI
  • Common Crawl (used by many AI companies for training)
  • Cohere
  • Meta AI
  • Apple (Applebot for AI features)
  • Amazon (Alexa AI)
  • Diffbot
  • Omgili (used for AI training)
Back to top