moglix.com
robots.txt

Robots Exclusion Standard data for moglix.com

Resource Scan

Scan Details

Site Domain moglix.com
Base Domain moglix.com
Scan Status Ok
Last Scan2024-11-10T12:56:06+00:00
Next Scan 2024-11-24T12:56:06+00:00

Last Scan

Scanned2024-11-10T12:56:06+00:00
URL https://moglix.com/robots.txt
Redirect https://www.moglix.com/robots.txt
Redirect Domain www.moglix.com
Redirect Base moglix.com
Domain IPs 35.154.255.26
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 618cdd32ad7b6a06b40599306c66539e6e1691f1edbeed216015a31af896602f
SimHash 511cd3528293

Groups

*

Rule Path
Disallow /404/
Disallow /cgi-bin/
Disallow /corporate-gifting
Disallow /dashboard
Disallow /search*
Disallow /quickorder
Disallow /new-products
Disallow /picture
Disallow /*?n=
Disallow /manufacturers
Disallow /checkout
Disallow /login
Disallow /*?id_category=
Disallow /*?id_supplier=
Disallow /*?p=
Disallow /*?amp%
Disallow /*?search_query=
Disallow /Log.php
Disallow /*?controller=
Disallow /offers/340000000
Disallow /*?category=
Disallow /rfq*
Disallow /q/*
Disallow /blog/*/?lang=
Disallow */mp/assets/img/*.svg
Disallow /ampc/*
Disallow /ampb/*
Disallow /ampcb/*
Disallow /ampl/*
Allow /*.js
Allow /*.css

googlebot

Rule Path
Disallow /blog/*/?lang=
Disallow /404/
Disallow /cgi-bin/
Disallow /corporate-gifting
Disallow /dashboard
Disallow /search*
Disallow /quickorder
Disallow /new-products
Disallow /picture
Disallow /*?n=
Disallow /manufacturers
Disallow /checkout
Disallow /login
Disallow /*?id_category=
Disallow /*?id_supplier=
Disallow /*?p=
Disallow /*?amp%
Disallow /*?search_query=
Disallow /Log.php
Disallow /*?controller=
Disallow /offers/340000000
Disallow /*?category=
Disallow /rfq*
Disallow /q/*
Disallow */mp/assets/img/*.svg
Disallow /ampc/*
Disallow /ampb/*
Disallow /ampcb/*
Disallow /ampl/*
Allow /*.js
Allow /*.css

googlebot-image

Rule Path
Disallow */mp/assets/img/*.svg

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bytespider

Product Comment
bytespider ByteDance
Rule Path
Disallow /

ccbot

Product Comment
ccbot Commoncrawl
Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.moglix.com/sitemap_index.xml
sitemap https://www.moglix.com/sitemap_index.xml

Comments

  • Disallowing subfolders and directories
  • Allowing Googlebots
  • Disallowing Known Bots