pixers.hk
robots.txt

Robots Exclusion Standard data for pixers.hk

Resource Scan

Scan Details

Site Domain pixers.hk
Base Domain pixers.hk
Scan Status Ok
Last Scan2024-09-20T18:23:02+00:00
Next Scan 2024-10-20T18:23:02+00:00

Last Scan

Scanned2024-09-20T18:23:02+00:00
URL https://pixers.hk/robots.txt
Domain IPs 5.135.115.151
Response IP 5.135.115.151
Found Yes
Hash 0c4f59bb7f975cda0497830c080b18dadfb0b86730afc5905bc92302a41cc954
SimHash 3b5e3b410209

Groups

*

Rule Path
Disallow /newsletter/
Disallow /wishlist/
Disallow /order/
Disallow /order/cookie/read$
Disallow /catalogue/media$
Disallow /catalogue/media?cart_*
Disallow /catalogue/price
Disallow /catalogue/refresh
Disallow /salesmanago_ajax/visit
Disallow /catalogue/configurator-popup
Disallow /public_html

zumbot
zmeu
zend_http_client
youdaobot
yodaobot
yisouspider
yamanalab-robot
xpymep\.exe
www\.integromedb\.org
wotbot
websitetheweb\.com
webindetail\.com
webcapture
wbsearchbot
visaduhoc\.info
turnitinbot
the\ incutio\ xml-rpc\ php\ library
surveybot
speedy
sosospider
solomonobot
sogou
socialsearcher
snoopy
sitebot
sistrix
shopwiki
seoengworldbot
semrushbot
searchmetrics
screenerbot
rojerbot
riddler
queryseekerspider
purebot
proximic
procogseobot
peoplepal
pagesinventory
openwebindex
ocelli
nextgensearchbot
netseer
netestate\ ne\ crawler
netcraftsurveyagent
ncbot
msie\ or\ firefox\ mutant
magpie\-crawler
ltbot
lipperhey
linkdex\.com
lindex\.com
libwww-perl
jikespider
jakarta\ commons-httpclient
ip\-web\-crawler\.com
indy\ library
gigabot
ftrf\:\ friendly
ezooms
ezinearticleslinkscanner
exabot
easouspider
dow\ jones\ searchbot
dotnetdotcom
dotbot
discoverybot
dinoping
dataprovider\.com
curious
compspybot
comodo-certificates-spider
comodo
clipish
charlotte
catchbot
butterfly
brandwatch\.net
baiduspider
backlinkcrawler
awcheckbot
aihitbot
ahrefsbot
add\ catalog
accelobot
aboundex
seo-crawling
blexbot
mj12bot
crawler
domaincrawler
spbot
scrapy
seokicks-robot
cliqzbot
linkdexbot
ucrawler

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Comments

  • Disallowed urls - Default Robots.txt
  • Bots
  • Google bots

Warnings

  • 18 invalid lines.