bluefanc.com
robots.txt

Robots Exclusion Standard data for bluefanc.com

Resource Scan

Scan Details

Site Domain bluefanc.com
Base Domain bluefanc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-14T03:56:31+00:00
Next Scan 2024-10-12T03:56:31+00:00

Last Successful Scan

Scanned2023-11-25T03:54:55+00:00
URL https://www.bluefanc.com/robots.txt
Domain IPs 104.21.2.36, 172.67.128.171, 2606:4700:3033::ac43:80ab, 2606:4700:3036::6815:224
Response IP 172.67.128.171
Found Yes
Hash 62231ad6ab4be6a7ed1a0af4461c2960fc02389fb9f6f7330fa9a005b025d53d
SimHash c27117fec673

Groups

*

Rule Path
Disallow /*?utm_source=
Disallow /*%26utm_source%3D
Disallow /*?gclid=
Disallow /*%26gclid%3D
Disallow /account
Disallow /checkout
Disallow /cart
Disallow /en/Products/
Disallow /Products/
Disallow /attribute-
Allow /*.css
Allow /*.jpg
Allow /*.png
Allow /collection
Allow /collections
Allow /newin
Allow /activity
Allow /item
Allow /products
Allow /contact-us
Allow /help
Disallow /*?

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

booch

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

downloader

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

hughcrawler

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

lcabotaccept

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

iupui

Rule Path
Disallow /

kittiecentral

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

peerbot

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

scspider

Rule Path
Disallow /

soft411

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

tamu

Rule Path
Disallow /

theusefulbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorial crawler

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wget

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Disallow
Disallow /en/Products/
Disallow /attribute-

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Comments

  • shopify old product link Disallow
  • Disallow: /products/
  • single product link Disallow
  • single product link Disallow
  • shopify old product link Disallow
  • shopify old product link Disallow
  • Disallow: /products/
  • single product link Disallow
  • single product link Disallow
  • Disallow: /Products/
  • shopify old product link Disallow