Log In Sign Up

fumo-shop.com
robots.txt

Robots Exclusion Standard data for fumo-shop.com

Resource Scan

Scan Details

Site Domain fumo-shop.com
Base Domain fumo-shop.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-03-19T15:20:31+00:00
Next Scan 2026-05-18T15:20:31+00:00

Last Successful Scan

Scanned2025-12-27T15:18:58+00:00
URL https://fumo-shop.com/robots.txt
Redirect http://www.fumo-shop.com/robots.txt
Redirect Domain www.fumo-shop.com
Redirect Base fumo-shop.com
Domain IPs 3.170.229.102, 3.170.229.114, 3.170.229.7, 3.170.229.91
Redirect IPs 3.170.229.102, 3.170.229.114, 3.170.229.7, 3.170.229.91
Response IP 3.170.229.7
Found Yes
Hash 821987ded0490e61324511d111d96e1539cd0118122e83fcb3128e4990d314f3
SimHash 890e4e92c191

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

storebot-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

google-inspectiontool

Rule Path
Disallow

googleother

Rule Path
Disallow

google-cloudvertexbot

Rule Path
Disallow

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 40

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /magento/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /skin/
Disallow /stats/
Disallow /var/
Disallow /404/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /control/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /magento-cleanup.php
Disallow /js/webforms/upload/
Disallow /fumoblock/ajax/related/
Disallow /productquestion/question/list/
Disallow /*.php$
Disallow /*?cat=
Disallow /*?manufacturer=
Disallow /*?stock=
Disallow /*?color=
Disallow /*?character=
Disallow /*?product_type=
Disallow /*?price=
Disallow /*?backlight=
Disallow /*?connection=
Disallow /*?layout=
Disallow /*?material=
Disallow /*?size=
Disallow /*?quantity=
Disallow /*?profile=
Disallow /*?v=
Disallow /*?hole=
Disallow /*?gad_source=
Disallow /*?form=
Disallow /*?collaboration=
Disallow /*?ecopt=
Disallow /*?SID=
Back to top

Other Records

Field Value
sitemap https://www.fumo-shop.com/sitemap.xml
Back to top

Comments

  • Sitemap(s)
  • âœ
  • Web & all Search features
  • Images
  • Video
  • Google Shopping surfaces (Merchant listings, Shopping tab)
  • Google Ads landing-page fetchers (if you ever run Google Ads)
  • Search Console / testing tools (Live URL Inspection, Rich Results Test)
  • Other Google crawlers used for non-Search fetches
  • Vertex AI Agents fetcher triggered by site owners (harmless to Search)
  • 🛑 Foreign search engines: BLOCK ALL
  • 🛑 SEO scrapers / low-value crawlers
  • 🌍 Everyone else (catch-all rules)
  • System / duplicate internals (safe to block for non-Google bots)
  • Duplicate/unhelpful routes (Magento internals)
  • Backend/irrelevant files
  • Facet & sort parameters (reduce crawl bloat for non-Google bots)
  • Disallow: /*?dir=
  • Disallow: /*?order=
  • Disallow: /*?mode=
Back to top

Warnings

  • `google crawlers` is not a known field.
Back to top