merconnet.com
robots.txt

Robots Exclusion Standard data for merconnet.com

Resource Scan

Scan Details

Site Domain merconnet.com
Base Domain merconnet.com
Scan Status Ok
Last Scan2025-10-07T00:20:51+00:00
Next Scan 2025-10-14T00:20:51+00:00

Last Scan

Scanned2025-10-07T00:20:51+00:00
URL https://merconnet.com/robots.txt
Redirect https://www.merconnet.com/robots.txt
Redirect Domain www.merconnet.com
Redirect Base merconnet.com
Domain IPs 104.21.32.16, 172.67.182.68, 2606:4700:3034::ac43:b644, 2606:4700:3035::6815:2010
Redirect IPs 104.21.32.16, 172.67.182.68, 2606:4700:3034::ac43:b644, 2606:4700:3035::6815:2010
Response IP 104.21.32.16
Found Yes
Hash 14f39cb1f297a1267b13e7f2e757893239f3604d3c5e5c891e0f280c70d8ec47
SimHash ed44bb0f03b0

Groups

*

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /*SID%3D
Disallow /*?dir*
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?*product_list_*
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /sendfriend/
Disallow /review/
Disallow /report/
Disallow /pkginfo/
Disallow /var/
Disallow /catalog/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /tag/
Disallow /amfile/file/download/
Disallow /amasty_mostviewed_bundles
Disallow /*-all-questions.html
Disallow /*.php$
Disallow /*.git$
Disallow /*.CVS$
Disallow /*.zip$
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.pdf$
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Allow /pub/media/
Allow /pub/sitemap/
Allow /pub/static/
Allow /*.css$
Allow /*.js$

Other Records

Field Value
sitemap https://www.merconnet.com/pub/sitemap/sitemap.xml

Comments

  • Block private and sensitive directories
  • Block unwanted file types
  • Block configuration & system files
  • Allow essential assets
  • Sitemap location