Log In Sign Up

home.sophos.com
robots.txt

Robots Exclusion Standard data for home.sophos.com

Resource Scan

Scan Details

Site Domain home.sophos.com
Base Domain sophos.com
Scan Status Ok
Last Scan2024-11-04T22:32:59+00:00
Next Scan 2024-11-18T22:32:59+00:00

Last Scan

Scanned2024-11-04T22:32:59+00:00
URL https://home.sophos.com/robots.txt
Domain IPs 23.59.168.130
Response IP 23.59.168.130
Found Yes
Hash ac52af701286762d572752a76132a46b228243377399a604997b8e32eb0295b5
SimHash a09d734bc541

Groups

*

Rule Path
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /profiles/*.svg
Disallow /core/
Disallow /profiles/
Disallow /README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips
Disallow /node/add/
Disallow /search/
Disallow /user/register
Disallow /user/password
Disallow /user/login
Disallow /user/logout
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password
Disallow /index.php/user/register
Disallow /index.php/user/login
Disallow /index.php/user/logout

*

Rule Path
Allow /en-us.aspx
Allow /de-de.aspx
Allow /fr-fr.aspx
Allow /it-it.aspx
Allow /es-es.aspx
Allow /ja-jp.aspx
Disallow /_$
Disallow /en-us/_$
Disallow /*/_$
Disallow /*_.aspx$
Disallow /en-us/*_.aspx$
Disallow /*cmp%3D
Disallow /*subId%3D
Disallow /*CMP%3D
Disallow /*cmp
Disallow /*%26utm_*
Disallow /*affiliate%3D
Disallow /*subid%3D
Disallow /*/edu/
Disallow /edu/
Disallow /employee/
Disallow /*/employee/
Disallow /en-us/employee/
Disallow /en-us/employee
Disallow /en-us/employee.aspx
Disallow /en-us/edu.aspx
Disallow /activate
Disallow /*/activate
Disallow /*login*
Disallow /confirm
Disallow /*/confirm
Disallow /confirmation
Disallow /*/confirmation
Disallow /*404*
Disallow /en-us/index1/
Disallow /en-us/index2/
Disallow /en-us/index.html$
Disallow /en-us/ipm/
Disallow /en-us/ipm/standard
Disallow /en-us/edu/
Disallow /en-us/redeem
Disallow /en-us/ipm.aspx
Disallow /en-us/ipm*
Disallow /*/ipm*
Disallow /*/ipm/
Disallow /de-de/index1/
Disallow /de-de/index2/
Disallow /de-de/ipm/
Disallow /de-de/ipm/standard
Disallow /de-de/edu/
Disallow /de-de/redeem
Disallow /de-de/employee/
Disallow /de-de/employee
Disallow /de-de/employee.aspx
Disallow /de-de/edu.aspx
Disallow /de-de/index1.aspx
Disallow /de-de/index2.aspx
Disallow /de-de/ipm.aspx
Disallow /fr-fr/index1/
Disallow /fr-fr/index2/
Disallow /fr-fr/ipm/
Disallow /fr-fr/ipm/standard
Disallow /fr-fr/edu/
Disallow /fr-fr/redeem
Disallow /fr-fr/employee/
Disallow /fr-fr/employee
Disallow /fr-fr/employee.aspx
Disallow /fr-fr/edu.aspx
Disallow /fr-fr/index1.aspx
Disallow /fr-fr/index2.aspx
Disallow /fr-fr/ipm.aspx
Disallow /ja-jp/index1/
Disallow /ja-jp/index2/
Disallow /ja-jp/ipm/
Disallow /ja-jp/ipm/standard
Disallow /ja-jp/edu/
Disallow /ja-jp/redeem
Disallow /ja-jp/employee/
Disallow /ja-jp/employee
Disallow /ja-jp/employee.aspx
Disallow /ja-jp/edu.aspx
Disallow /ja-jp/index1.aspx
Disallow /ja-jp/index2.aspx
Disallow /ja-jp/ipm.aspx
Disallow /es-es/index1/
Disallow /es-es/index2/
Disallow /es-es/ipm/
Disallow /es-es/ipm/standard
Disallow /es-es/edu/
Disallow /es-es/redeem
Disallow /es-es/employee/
Disallow /es-es/employee
Disallow /es-es/employee.aspx
Disallow /es-es/edu.aspx
Disallow /es-es/index1.aspx
Disallow /es-es/index2.aspx
Disallow /es-es/ipm.aspx
Disallow /it-it/index1/
Disallow /it-it/index2/
Disallow /it-it/ipm/
Disallow /it-it/ipm/standard
Disallow /it-it/edu/
Disallow /it-it/redeem
Disallow /it-it/employee/
Disallow /it-it/employee
Disallow /it-it/employee.aspx
Disallow /it-it/edu.aspx
Disallow /it-it/index1.aspx
Disallow /it-it/index2.aspx
Disallow /it-it/ipm.aspx
Disallow /Documents/
Disallow /documents/
Disallow /*/index1/
Disallow /*/index2/
Disallow /*/ipm/
Disallow /*/ipm/standard
Disallow /*/edu/
Disallow /*/redeem
Disallow /*/employee/
Disallow /*/employee
Disallow /*/employee.aspx
Disallow /*/edu.aspx
Disallow /*/index1.aspx
Disallow /*/index2.aspx
Disallow /*/ipm.aspx
Disallow /index1/
Disallow /index2/
Disallow /ipm/
Disallow /ipm/standard
Disallow /redeem
Disallow /employee/
Disallow /employee
Disallow /employee.aspx
Disallow /*/employee/
Disallow /edu.aspx
Disallow /index1.aspx
Disallow /index2.aspx
Disallow /ipm.aspx
Disallow /*coupon%3D
Disallow /*index1*
Disallow /*index2*
Disallow /index.aspx
Disallow /index1.aspx
Disallow /index2.aspx
Disallow /index3.aspx
Disallow /index4.aspx
Disallow /index5.aspx
Disallow /index6.aspx
Disallow /index7.aspx
Disallow /landing/
Disallow /landing/*
Disallow /*/landing
Disallow /*/landing/
Disallow /*/landing/*
Disallow /*landing*
Disallow /*expire*
Disallow /trial-expire-win
Disallow /trial-expire-mac
Disallow /*/trial-expire-win
Disallow /*/trial-expire-mac
Disallow /*expire*
Disallow /relnotes
Disallow /employee/
Disallow /employee*
Disallow /en-us/employee.aspx
Disallow /*/employee.aspx
Disallow /*/employee*
Disallow /*sitecore*
Disallow /*layouts*
Disallow /*console*
Disallow /support
Disallow /*/support/
Disallow /*install*
Disallow /install/*
Disallow /*/install/*
Disallow /*confirm*
Disallow /confirm/*
Disallow /*/confirm/*
Disallow /*forgot*
Disallow /forgot/*
Disallow /*/forgot/*
Disallow /landing/*
Disallow /*/landing/
Disallow /edu/
Disallow /*/edu/
Disallow /edu
Disallow /*/edu
Disallow /*/edu*
Disallow /edu*
Disallow /*/edu/
Disallow /edu/
Disallow /*/edu.aspx
Disallow /*/landing.aspx
Disallow /*/eplogin.aspx
Disallow /*/redeem/
Disallow /redeem.aspx
Disallow /*/redeem.aspx
Disallow /*confirmation*
Disallow /*/confirmation
Disallow /*confirm*
Disallow /comingsoon
Disallow /*/comingsoon*
Disallow /*expire*
Disallow /employee/*
Disallow /*/employee/
Disallow /*/employee*
Disallow /employee
Disallow /*/employee
Disallow /edu/
Disallow /*/edu/
Disallow /*/edu
Disallow /*wvu*
Disallow /*/wvu/
Disallow /*/wvu
Disallow /register/sophos
Disallow /*/register/sophos
Disallow /register/bmcracing
Disallow /*/register/bmcracing
Disallow /register/wmu
Disallow /register/BMCracing
Disallow /*/register/umass*
Disallow /*/register/wvu*
Disallow /register/wvu
Disallow /*/register/bmcracing*
Disallow /redeem/
Disallow /*/redeem
Disallow /*/cookieinfo
Disallow /cookieinfo
Disallow /*/version2/
Disallow /version2/
Disallow /*/version2
Disallow /*/version2/
Disallow /*/test
Disallow /test
Disallow /*/test
Disallow /*test*
Disallow /*/TEST/
Disallow /TEST
Disallow /*/TEST.aspx
Disallow /*404*
Disallow /*403*
Disallow /*500*
Disallow /*error*
Disallow /*/tag
Disallow /*/error
Disallow /*/thank*
Disallow /*?q=*
Disallow /admin
Disallow /hi-in.aspx
Disallow /yy-xx.aspx
Disallow /*.do$
Disallow /*.ru$
Disallow /*.dll$
Disallow /*/index*.aspx
Disallow /*/index*
Disallow /*/index2*
Disallow /*/index3*
Disallow /*/index1*
Disallow /*/*/index*
Disallow /*/*/*/index*
Disallow /index*
Allow /en-us/security-center.aspx
Allow /en-us/security-center/
Allow /en-us/security-center/articles/
Allow /en-us/security-center/definitions/
Allow /en-us/content/
Allow /en-us/security-news.aspx
Allow /en-us/security-news/
Allow /en-us/security-news
Allow /en-us/customers.aspx
Disallow /*/content/
Disallow /*/customers.aspx
Disallow /security-center.aspx
Disallow /*/security-center.aspx
Disallow /*/security-center/
Disallow /*/security-center*
Disallow /*/security-center/articles/
Disallow /*/security-center/definitions/
Disallow /cs-cz/security-news.aspx
Disallow /cs-cz/security-news/
Disallow /cs-cz
Disallow /de-de/security-news.aspx
Disallow /de-de/security-news/
Disallow /de-de/security-news
Disallow /es-es/security-news.aspx
Disallow /es-es/security-news/
Disallow /es-es/security-news
Disallow /fr-fr/security-news.aspx
Disallow /fr-fr/security-news/
Disallow /fr-fr/security-news
Disallow /hu-hu/security-news.aspx
Disallow /hu-hu/security-news/
Disallow /hu-hu
Disallow /it-it/security-news.aspx
Disallow /it-it/security-news/
Disallow /it-it/security-news
Disallow /ja-jp/security-news.aspx
Disallow /ja-jp/security-news/
Disallow /ja-jp/security-news
Disallow /ko-kr/security-news.aspx
Disallow /ko-kr/security-news/
Disallow /ko-kr/security-news
Disallow /ko-kr
Disallow /pl-pl/security-news.aspx
Disallow /pl-pl/security-news/
Disallow /pl-pl
Disallow /pt-br/security-news.aspx
Disallow /pt-br/security-news/
Disallow /pt-br
Disallow /tr-tr/security-news.aspx
Disallow /tr-tr/security-news/
Disallow /tr-tr
Disallow /zh-cn/security-news.aspx
Disallow /zh-cn/security-news/
Disallow /zh-cn/security-news
Disallow /zh-tw/security-news.aspx
Disallow /zh-tw/security-news/
Disallow /zh-tw
Disallow /*/security-center.aspx
Disallow /*/security/center/
Disallow /cs-cz/articles.aspx
Disallow /cs-cz/articles/
Disallow /de-de/articles.aspx
Disallow /de-de/articles/
Disallow /es-es/articles.aspx
Disallow /es-es/articles/
Disallow /fr-fr/articles.aspx
Disallow /fr-fr/articles/
Disallow /hu-hu/articles.aspx
Disallow /hu-hu/articles/
Disallow /it-it/articles.aspx
Disallow /it-it/articles/
Disallow /ja-jp/articles.aspx
Disallow /ja-jp/articles/
Disallow /ko-kr/articles.aspx
Disallow /ko-kr/articles/
Disallow /pl-pl/articles.aspx
Disallow /pl-pl/articles/
Disallow /pt-br/articles.aspx
Disallow /pt-br/articles/
Disallow /tr-tr/articles.aspx
Disallow /tr-tr/articles/
Disallow /zh-cn/articles.aspx
Disallow /zh-cn/articles/
Disallow /zh-tw/articles.aspx
Disallow /zh-tw/articles/
Disallow /cs-cz/content.aspx
Disallow /cs-cz/content/
Disallow /de-de/content.aspx
Disallow /de-de/content/
Disallow /es-es/content.aspx
Disallow /es-es/content/
Disallow /fr-fr/content.aspx
Disallow /fr-fr/content/
Disallow /hu-hu/content.aspx
Disallow /hu-hu/content/
Disallow /it-it/content.aspx
Disallow /it-it/content/
Disallow /ja-jp/content.aspx
Disallow /ja-jp/content/
Disallow /ko-kr/content.aspx
Disallow /ko-kr/content/
Disallow /pl-pl/content.aspx
Disallow /pl-pl/content/
Disallow /pt-br/content.aspx
Disallow /pt-br/content/
Disallow /tr-tr/content.aspx
Disallow /tr-tr/content/
Disallow /zh-cn/content.aspx
Disallow /zh-cn/content/
Disallow /zh-tw/content.aspx
Disallow /zh-tw/content/
Disallow /cs-cz/register/trial.aspx
Disallow /cs-cz/register.aspx
Disallow /hu-hu/register/trial.aspx
Disallow /hu-hu/register.aspx
Disallow /ko-kr/register/trial.aspx
Disallow /ko-kr/register.aspx
Disallow /pl-pl/register/trial.aspx
Disallow /pl-pl/register.aspx
Disallow /pt-br/register/trial.aspx
Disallow /pt-br/register.aspx
Disallow /tr-tr/register/trial.aspx
Disallow /tr-tr/register.aspx
Disallow /zh-cn/register/trial.aspx
Disallow /zh-cn/register.aspx
Disallow /zh-tw/register/trial.aspx
Disallow /zh-tw/register.aspx
Disallow /*/EPLogin
Disallow /EPLogin.aspx
Disallow /*/EPLogin.aspx
Allow /hc/en-us
Allow /hc/en-us/
Disallow /hc/fr-fr/
Disallow /hc/es-es/
Disallow /hc/it-it/
Disallow /hc/de-de/
Disallow /hc/ja-jp/
Disallow /hc/zh-cn/
Disallow /hc/zh-tw/
Disallow /hc/hu-hu/
Disallow /hc/tr-tr/
Disallow /hc/cs-cz/
Disallow /hc/ko-kr/
Disallow /hc/pt-br/
Disallow /hc/pl-pl/
Disallow /hc/*/
Disallow /ipm/*
Disallow /ipm/*
Disallow /*/ipm/
Disallow /*/ipm
Disallow /en-us/ipm/
Disallow /*ipm$
Disallow /hu-hu
Disallow /pl-pl
Disallow /cs-cz
Disallow /zh-cn
Disallow /zh-tw
Disallow /ko-kr
Disallow /pt-br
Disallow /tr-tr
Disallow /hu-hu/
Disallow /cs-cz/
Disallow /zh-cn/
Disallow /zh-tw/
Disallow /ko-kr/
Disallow /pt-br/
Disallow /pl-pl/
Disallow /tr-tr/
Disallow /tr-tr.aspx
Disallow /pt-br.aspx
Disallow /ko-kr.aspx
Disallow /zh-tw.aspx
Disallow /zh-cn.aspx
Disallow /cs-cz.aspx
Disallow /hu-hu.aspx
Disallow /pl-pl.aspx
Disallow /redeem
Disallow /*/redeem
Disallow /redeem.aspx
Disallow /redeem/
Disallow /*/redeem/
Disallow /*redeem*
Disallow /*/redeem.aspx
Disallow /premium.aspx
Disallow /*/premium.aspx
Disallow /eplogin.aspx
Disallow /*/eplogin.aspx
Disallow /*cmp%3D*
Disallow /*cmp*
Disallow /*/cmp
Disallow /*/cmp*
Disallow /*cmp*
Disallow /*/*cmp*
Disallow /*/*utm*
Disallow /*utm*
Disallow /*source*
Disallow /*medium*
Disallow /*campaign*
Disallow /products/
Disallow /*/products/
Disallow /*404*
Disallow /*500*
Disallow /*config*
Disallow /*dashboard*
Disallow /*device*
Disallow /*status*
Disallow /*purl*
Disallow /*1461*
Disallow /help
Disallow /*/help
Disallow /*help*
Disallow /*display*
Disallow /en-us/edu.aspx
Disallow /*/employee.aspx
Disallow /*.axd
Disallow /*.axd*
Disallow /en-us/_.aspx$
Disallow /_$
Disallow /en-us/_$
Disallow /*/_$
Disallow /*_.aspx$
Disallow /en-us/*_.aspx$
Disallow /*cmp%3D
Disallow /*subId%3D
Disallow /*CMP%3D
Disallow /*cmp
Disallow /*affiliate%3D
Disallow /*subid%3D
Disallow /en-us/index1/
Disallow /en-us/index2/
Disallow /en-us/ipm/
Disallow /en-us/ipm/standard
Disallow /en-us/edu/
Disallow /en-us/redeem
Disallow /en-us/employee/
Disallow /en-us/employee
Disallow /en-us/employee.aspx
Disallow /en-us/edu.aspx
Disallow /en-us/index1.aspx
Disallow /en-us/index2.aspx
Disallow /en-us/ipm.aspx
Disallow /de-de/index1/
Disallow /de-de/index2/
Disallow /de-de/ipm/
Disallow /de-de/ipm/standard
Disallow /de-de/edu/
Disallow /de-de/redeem
Disallow /de-de/employee/
Disallow /de-de/employee
Disallow /de-de/employee.aspx
Disallow /de-de/edu.aspx
Disallow /de-de/index1.aspx
Disallow /de-de/index2.aspx
Disallow /de-de/ipm.aspx
Disallow /fr-fr/index1/
Disallow /fr-fr/index2/
Disallow /fr-fr/ipm/
Disallow /fr-fr/ipm/standard
Disallow /fr-fr/edu/
Disallow /fr-fr/redeem
Disallow /fr-fr/employee/
Disallow /fr-fr/employee
Disallow /fr-fr/employee.aspx
Disallow /fr-fr/edu.aspx
Disallow /fr-fr/index1.aspx
Disallow /fr-fr/index2.aspx
Disallow /fr-fr/ipm.aspx
Disallow /ja-jp/index1/
Disallow /ja-jp/index2/
Disallow /ja-jp/ipm/
Disallow /ja-jp/ipm/standard
Disallow /ja-jp/edu/
Disallow /ja-jp/redeem
Disallow /ja-jp/employee/
Disallow /ja-jp/employee
Disallow /ja-jp/employee.aspx
Disallow /ja-jp/edu.aspx
Disallow /ja-jp/index1.aspx
Disallow /ja-jp/index2.aspx
Disallow /ja-jp/ipm.aspx
Disallow /es-es/index1/
Disallow /es-es/index2/
Disallow /es-es/ipm/
Disallow /es-es/ipm/standard
Disallow /es-es/edu/
Disallow /es-es/redeem
Disallow /es-es/employee/
Disallow /es-es/employee
Disallow /es-es/employee.aspx
Disallow /es-es/edu.aspx
Disallow /es-es/index1.aspx
Disallow /es-es/index2.aspx
Disallow /es-es/ipm.aspx
Disallow /it-it/index1/
Disallow /it-it/index2/
Disallow /it-it/ipm/
Disallow /it-it/ipm/standard
Disallow /it-it/edu/
Disallow /it-it/redeem
Disallow /it-it/employee/
Disallow /it-it/employee
Disallow /it-it/employee.aspx
Disallow /it-it/edu.aspx
Disallow /it-it/index1.aspx
Disallow /it-it/index2.aspx
Disallow /it-it/ipm.aspx
Disallow /Documents/
Disallow /documents/
Disallow /*/index1/
Disallow /*/index2/
Disallow /*/ipm/
Disallow /*/ipm/standard
Disallow /*/edu/
Disallow /*/redeem
Disallow /*/edu.aspx
Disallow /*/index1.aspx
Disallow /*/index2.aspx
Disallow /*/ipm.aspx
Disallow /index1/
Disallow /index2/
Disallow /ipm/
Disallow /ipm/standard
Disallow /edu/
Disallow /redeem
Disallow /index1.aspx
Disallow /index2.aspx
Disallow /ipm.aspx
Disallow /*coupon%3D
Disallow /*index1*
Disallow /*index2*

bingbot

Rule Path
Disallow /en-us/search-results.aspx

ahrefsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

asterias

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

black hole

Rule Path
Disallow /

blowfish/1.0

Rule Path
Disallow /

botalot

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

bullseye/1.0

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

cegbfeieh

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

cherrypickerelite/1.0

Rule Path
Disallow /

cherrypickerse/1.0

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

crescent

Rule Path
Disallow /

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

foobot

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

hloader

Rule Path
Disallow /

httplib

Rule Path
Disallow /

humanlinks

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

kenjin spider

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

libweb/clshttp

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

microsoft url control - 5.01.4511

Rule Path
Disallow /

microsoft url control - 6.00.8169

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

miixpc/4.2

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

moget

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

mozilla/4

Rule Path
Disallow /

mozilla/4.0 (compatible; bullseye; windows 95)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows 95)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows 98)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows nt)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows xp)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows 2000)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows me)

Rule Path
Disallow /

mozilla/5

Rule Path
Disallow /

netants

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

openfind

Rule Path
Disallow /

openfind data gathere

Rule Path
Disallow /

propowerbot/2.14

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

queryn metasearch

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

repomonkey bait & tackle/v1.01

Rule Path
Disallow /

rma

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

tighttwatbot

Rule Path
Disallow /

titan

Rule Path
Disallow /

tocrawl/urldispatcher

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

turingos

Rule Path
Disallow /

urly warning

Rule Path
Disallow /

vci

Rule Path
Disallow /

vci webviewer vci webviewer win32

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

websauger

Rule Path
Disallow /

website quester

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

wget

Rule Path
Disallow /

wget/1.5.3

Rule Path
Disallow /

wget/1.6

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://home.sophos.com/sitemap.xml
Back to top

Comments

  • robots.txt for home.sophos.com 022422
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • robots.txt = Legacy
  • Update
  • New
  • In-product messaging
  • Regions
  • FY21
  • Bot Requests
Back to top