cotosen.com
robots.txt

Robots Exclusion Standard data for cotosen.com

Resource Scan

Scan Details

Site Domain cotosen.com
Base Domain cotosen.com
Scan Status Ok
Last Scan2024-05-22T08:10:32+00:00
Next Scan 2024-06-21T08:10:32+00:00

Last Scan

Scanned2024-05-22T08:10:32+00:00
URL https://cotosen.com/robots.txt
Redirect https://www.cotosen.com/robots.txt
Redirect Domain www.cotosen.com
Redirect Base cotosen.com
Domain IPs 47.254.36.199
Redirect IPs 35.201.89.238
Response IP 35.201.89.238
Found Yes
Hash 62231ad6ab4be6a7ed1a0af4461c2960fc02389fb9f6f7330fa9a005b025d53d
SimHash c27117fec673

Groups

*

Rule Path
Disallow /*?utm_source=
Disallow /*%26utm_source%3D
Disallow /*?gclid=
Disallow /*%26gclid%3D
Disallow /account
Disallow /checkout
Disallow /cart
Disallow /en/Products/
Disallow /Products/
Disallow /attribute-
Allow /*.css
Allow /*.jpg
Allow /*.png
Allow /collection
Allow /collections
Allow /newin
Allow /activity
Allow /item
Allow /products
Allow /contact-us
Allow /help
Disallow /*?

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

booch

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

downloader

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

hughcrawler

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

lcabotaccept

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

iupui

Rule Path
Disallow /

kittiecentral

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

peerbot

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

scspider

Rule Path
Disallow /

soft411

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

tamu

Rule Path
Disallow /

theusefulbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorial crawler

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wget

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Disallow
Disallow /en/Products/
Disallow /attribute-

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Comments

  • shopify old product link Disallow
  • Disallow: /products/
  • single product link Disallow
  • single product link Disallow
  • shopify old product link Disallow
  • shopify old product link Disallow
  • Disallow: /products/
  • single product link Disallow
  • single product link Disallow
  • Disallow: /Products/
  • shopify old product link Disallow