sohomod.com
robots.txt

Robots Exclusion Standard data for sohomod.com

Resource Scan

Scan Details

Site Domain sohomod.com
Base Domain sohomod.com
Scan Status Ok
Last Scan2026-02-15T21:27:16+00:00
Next Scan 2026-03-17T21:27:16+00:00

Last Scan

Scanned2026-02-15T21:27:16+00:00
URL https://sohomod.com/robots.txt
Domain IPs 172.66.40.165, 172.66.43.91, 2606:4700:3108::ac42:28a5, 2606:4700:3108::ac42:2b5b
Response IP 172.66.40.165
Found Yes
Hash a74dee76d371691d9149ed0bc5ecf8435e194577d233d2904f713fdad58aa39b
SimHash 8534c9e3ebdb

Groups

*

Rule Path
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /var/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /ajaxpage/
Disallow /search/
Disallow /searchsphinx/*
Disallow /quickview/index/*
Disallow /ajaxpage/index/*
Disallow /fpc/*
Disallow /ajaxpage/cart/affirm*
Disallow */show/*
Disallow */sort-by/*
Disallow /*?SID=
Disallow /*?p=*&
Disallow /*.php$
Disallow /reviews/index/
Disallow /*?*

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /quickview/index/*
Disallow /ajaxpage/index/*
Disallow /fpc/*
Disallow /searchsphinx/*
Disallow /search/*
Disallow /ajaxpage/cart/affirm*
Disallow /wishlist/
Disallow */sort-by/*
Disallow /catalogsearch/
Disallow /catalog/product/view/
Disallow /catalog/category/view/

googlebot-image

Rule Path
Disallow /quickview/index/*
Disallow /ajaxpage/index/*
Disallow /fpc/*
Disallow /searchsphinx/*
Disallow /search/*
Disallow /ajaxpage/cart/affirm*
Disallow */show/*
Disallow /wishlist/
Disallow */sort-by/*

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sohomod.com/main_cms.xml
sitemap https://www.sohomod.com/main_cat.xml
sitemap https://www.sohomod.com/main_prod.xml
sitemap https://www.sohomod.com/main_prod_out.xml
sitemap https://www.sohomod.com/main_articles.xml
sitemap https://www.sohomod.com/feeds/sitemap_images_1.xml
sitemap https://www.sohomod.com/feeds/sitemap_images_2.xml
sitemap https://www.sohomod.com/feeds/sitemap_video_1.xml

Comments

  • Website Sitemap
  • Crawlers Setup
  • Block directories and files
  • Block paths with no clean URLs and unnecessary filters
  • Block filtered URLs with query parameters
  • Block unnecessary bots and crawlers
  • Googlebot setup (limit unnecessary indexing)