saviorybricks.com
robots.txt

Robots Exclusion Standard data for saviorybricks.com

Resource Scan

Scan Details

Site Domain saviorybricks.com
Base Domain saviorybricks.com
Scan Status Ok
Last Scan2025-12-19T20:22:11+00:00
Next Scan 2026-01-18T20:22:11+00:00

Last Scan

Scanned2025-12-19T20:22:11+00:00
URL https://www.saviorybricks.com/robots.txt
Domain IPs 104.26.12.122, 104.26.13.122, 172.67.72.62, 2606:4700:20::681a:c7a, 2606:4700:20::681a:d7a, 2606:4700:20::ac43:483e
Response IP 104.26.13.122
Found Yes
Hash 57999a99ada7822a3cbc0bc219b0b17c99893bf884701ff82255e3a87e19ce67
SimHash d0d4ec124517

Groups

*

Rule Path
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /themes/
Disallow /search/
Disallow /user/password/
Disallow /user/logout/
Disallow /ajax/
Disallow /action/
Disallow /user/
Disallow /user?*
Disallow /addtocart
Disallow /*/edit_inventory
Disallow /*/partout
Disallow /*/comesin
Disallow /*?
Allow /*.css?
Allow /*.js?
Allow /*?is_gm=1
Disallow /toggle_desktop*
Disallow /viewfile
Disallow /hide_buying_guide*
Disallow /wishlist_pagejax/*
Disallow /*/*packaging$
Allow /ajax/dt_buy
Allow /files/image_cache/*?
Disallow /*/viewer
Allow /catalog/*/viewer

mj12bot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /help/
Disallow /checkout/
Disallow /user

Comments

  • Directories
  • Paths
  • Nothing with a parameter
  • Except CSS/JS for whitelabel
  • Except is_gm for google merchant
  • Dont index any packaging
  • Allow this ajax path
  • Allow whitelabel ICO
  • Regional
  • Block certian bots