modmymods.com
robots.txt

Robots Exclusion Standard data for modmymods.com

Resource Scan

Scan Details

Site Domain modmymods.com
Base Domain modmymods.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-28T10:23:59+00:00
Next Scan 2026-03-29T10:23:59+00:00

Last Successful Scan

Scanned2025-11-06T00:02:57+00:00
URL https://modmymods.com/robots.txt
Domain IPs 104.26.0.104, 104.26.1.104, 172.67.74.28, 2606:4700:20::681a:168, 2606:4700:20::681a:68, 2606:4700:20::ac43:4a1c
Response IP 172.67.74.28
Found Yes
Hash ee3b13e9cd099ca4bbe7c7aa6588e370e69b1d735d5fd902cbbd4063e9534bc9
SimHash 650ceac146f0

Groups

*

Rule Path
Disallow /admin/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /LICENSE*
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /*?dir=
Disallow /*?limit=all
Disallow /*?mode=
Disallow /*?p=*
Disallow /*?SID=
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /phpinfo.php
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.svn$
Disallow /*.idea$

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

pcpartspicker

Rule Path
Disallow

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.modmymods.com/sitemap.xml

Comments

  • Robots.txt for Magento 1.9 - Optimized for Security & Performance
  • ========================
  • GENERAL SETTINGS
  • ========================
  • ========================
  • MAGENTO SEO IMPROVEMENTS
  • ========================
  • ========================
  • SERVER SETTINGS
  • ========================
  • ========================
  • SITEMAP
  • ========================
  • ========================
  • ALLOW GOOGLE, BING, PCPARTSPICKER
  • ========================
  • ========================
  • BLOCK BAD BOTS
  • ========================