Log In Sign Up

paixaoporfut.com
robots.txt

Robots Exclusion Standard data for paixaoporfut.com

Resource Scan

Scan Details

Site Domain paixaoporfut.com
Base Domain paixaoporfut.com
Scan Status Ok
Last Scan2024-11-12T09:53:22+00:00
Next Scan 2024-11-19T09:53:22+00:00

Last Scan

Scanned2024-11-12T09:53:22+00:00
URL https://paixaoporfut.com/robots.txt
Domain IPs 104.21.65.254, 172.67.196.170, 2606:4700:3030::ac43:c4aa, 2606:4700:3031::6815:41fe
Response IP 104.21.65.254
Found Yes
Hash 96af138ba978ecd08f4e7238c91a0df90e55cf06d73c05651da97331be37dfd8
SimHash 28635213caa3

Groups

googlebot

Rule Path
Allow /*.css$
Allow /*.js$
Allow /wp-content/uploads/
Allow /wp-content/uploads/*
Allow /wp-content/themes/
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /wp-*.webp
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*
googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /
Disallow /wp-includes/

googlebot-video

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

storebot-google

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

google-extended

Rule Path
Allow /

googleother

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

applebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

techicalseodotcom

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /

botify

Rule Path
Allow /

oncrawl

Rule Path
Allow /

rogerbot

Rule Path
Allow /

dotbot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

bytespider

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

noxtrumbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /
Disallow /wp-includes/

adidxbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

slurp

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

yepbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /
Disallow /wp-includes/

baiduspider-mobile

Rule Path
Allow /

baiduspider-news

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider+(+http://www.baidu.com/search/spider_jp.html)

Rule Path
Allow /

yandex

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

*

Rule Path
Allow /wp-content/uploads/*
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /*/newsletter/*
Disallow *?attachment_id=
Disallow */?fbclid=*
Disallow */?filter*
Disallow */?orderby=*
Disallow */?url=*
Disallow */?utm_source=*
Disallow *%26s%3D
Disallow *comments
Disallow *cookies*
Disallow *cuenta/
Disallow *data*
Disallow *login*
Disallow *senha*
Disallow /?attachment_id*
Disallow /?s=
Disallow /*?
Disallow /*?s=
Disallow /*?sort=
Disallow /*.cgi$
Disallow /*.css$
Disallow /*.inc$
Disallow /*.js$
Disallow /*.php$
Disallow /*.wmv$
Disallow /*.xhtml$
Disallow /*/?s=
Disallow /*/*?sort=
Disallow /*/attachment/
Disallow /*/aviso-legal/*
Disallow /*/cookie-policy/*
Disallow /*/cookie-ricthlinie/*
Disallow /*/datenschutzbestimmungen/*
Disallow /*/landings/*
Disallow /*/login*
Disallow /*/login/*
Disallow /*/login/*
Disallow /*/newsletter/*
Disallow /*/newsletter/*
Disallow /*/politica-cookies/*
Disallow /*/privacy-policy/*
Disallow /*/profesional/*
Disallow /*/proteccion-de-datos/*
Disallow /*/purchase-conditions/*
Disallow /*/search
Disallow /author/
Disallow /cgi-bin
Disallow /cgi-bin/
Disallow /comments/
Disallow /genera-pdf/*
Disallow /page/
Disallow /search
Disallow /search
Disallow /tag/*/feed/
Disallow /tag/*/page/
Disallow /wp-
Disallow /wp-admin
Disallow /wp-content/cache/
Disallow /wp-content/cache/*
Disallow /wp-content/old/*
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /politica-de-privacidade/
Disallow /*.git$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /*.bz2$
Disallow /*.log$
Disallow /*.zip$
Disallow /*.old$
Disallow /*/politica-de-privacidade/*

*

Rule Path
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback

*

Rule Path
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /*/page/*
Disallow /*/*/page/*
Disallow /*/*/*/page/*
Disallow /*/*/*/*/page/*
Disallow /*/pagina/*
Disallow /*/*/pagina/*
Disallow /*/*/*/pagina/*
Disallow /*/*/*/*/pagina/*
Disallow /*.html$
Disallow /*.htm$

ia_archiver
gptbot
chatgpt-user
oai-searchbot
aisearchbot
alexibot
amazoncloudservices
apexoo spider 1.0
aqua_products
arachnoidea
architextspider
aspsimply
asterias
attributorcorporationdmcabot
avant+browser+
axonize-bot
b2w/0.1
backdoorbot
backdoorbot/1.0
becomebot
becomebot/3.0
bitacle
bitacle bot
bitacle bot/1.1
bitacle*
black hole
blackwidow
blowfish
blowfish/1.0
blowfish/1.0
blp_bbot/0.1
bobcrawl
boitho
boitho.com
bookmark search tool
bookmark search tool
bork-edition
bot mailto:craftbot@yahoo.com
bot/1.0
bot/1.0+(bot;+http://;+bot@bot.bot)
botalot
botmobi
botrighthere
bsalsa
builtbottough
builtbottough
bullseye
bullseye/1.0
bunnyslippers
butterfly
cazoodle-bot
cazoodlebot
cegbfeieh
charlotte
cheesebot
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
classroombot
compatible ;
converacrawler/0.9d
converacrawler/0.9e
copernic
copyrightcheck
cosmos
crawl13.exabot.com
crawl6.exabot.com
crescent
crescent internet toolpak http ole control v.1.0
curl
custo
cyberpatrol
cyberpatrolcrawler
datacha0s/2.0
dblbot
dcbot
del.icio.us
del.icio.us-thumbnails/1.0
depspid
disco
disco pump 3.0
disco pump 3.2
discobot
discofinder
dittospyder
dittospyder
doc
docomo
dotbot
dotbot
download demon
download demon/3.2.0.8
download demon/3.5.0.11
download ninja
dtaagent
eagle
ecatch
ecatch/3.0
ee:
eirgrabber
emailcollector
emailsiphon
emailwolf
envolk
erocrawler
eudora
everest-vulcan
exabot
exabot-images/1.0
exabot-images/3.0
exabot/2.0
exabot/3.0
exooba
express webpictures
express webpictures (www.express-soft.com)
extractorpro
eyenetie
fairad client
fairshare
fast
fast enterprise crawler
fast metaweb crawler
fast-webcrawler
fetch
fetch api request
findlinks/1.1.1-a5
findlinks/1.1.3-beta9
flaming attackbot
flashget
flashget webwasher 3.2
flatlandbot
followsitebot
foobot
frontpage
frontpage [nc,or]
funwebproducts
funwebproducts f39-2350
fyberspider
gaisbot
geniebot
geniebot (wgao@genieknows.com)
geniebot+(wgao@genieknows.com)
geniebot+wgao@genieknows.com
getright
getright/2.11
getright/3.1
getright/3.2
getright/3.3
getright/3.3.3
getright/3.3.4
getright/4.0.0
getright/4.1.0
getright/4.1.1
getright/4.1.2
getright/4.2
getright/4.2b (portuguxeas)
getright/4.2c
getright/4.3
getright/4.5
getright/4.5a
getright/4.5b
getright/4.5b1
getright/4.5b2
getright/4.5b3
getright/4.5b6
getright/4.5b7
getright/4.5c
getright/4.5d
getright/4.5e
getright/5.0beta1
getright/5.0beta2
getweb!
gigabot
gigabot*
gigabot/2.0
gingercrawler
go-ahead-got-it
go!zilla
go!zilla (www.gozilla.com)
go!zilla 3.3 (www.gozilla.com)
go!zilla 3.5 (www.gozilla.com)
grabnet
grafula
grub
grub-client
grub-client
gsa-crawler
gt::www
gulliver
harvest
harvest/1.5
harvest/1.5
henrythemiragorobot
heritrix
heritrix/1.12.1 +http://www.page-store.com)
hloader
hmse_robot
hmview
hornysexsearch
http client
http::lite
http://www.almaden.ibm.com/cs/crawler
http://www.cuill.com/twiceler/robot.html
http/1.1 zibber-v0.1(www.zibb.com/crawler/)
httplib
httrack
httrack [nc,or]
httrack 3.0
humanlinks
ia_archive
ia_archiver
ia_archiver-web.archive.org
ia_archiver/1.6
ibm
ibm evv
ibm_planetwide
ichiro
ichiro/2.0
ichiro/2.0 (ichiro@nttr.co.jp)
ichiro/2.0+(http://help.goo.ne.jp/door/crawler.html)
iconsurf
image stripper
image sucker
indy library
indy library [nc,or]
infonavirobot
infonavirobot
infopath
infopath.1
infopath.2
integratelecom
interget
internet ninja
internet ninja 4.0
internet ninja 5.0
internet ninja 6.0
internetseer
internetseer.com
ips-agent
irlbot
irlbot/3.0
irlbot/3.0 (compatible; msie 6.0; http://irl.cs.tamu.edu/crawler)
iron33/1.0.2
isc systems irc search 2.1
isidorus
jakarta commons-httpclient
java
java bot 2.0
java/1.4.1_04
java/1.5.0_05
java/1.5.0_06
java/1.5.0_10
java/1.6.0_04
java/1.6.0_07
java/1.6.0_11
java/1.6.0_13
javabot
javabot 2.0
jennybot
jetcar
joc web spider
jyxobot
kalooga
kaloogabot
kenjin spider
keyword density/0.9
keyword.density
kyluka
labot
larbin
larbin (samualt9@bigfoot.com)
larbin_2.6.1
larbin_2.6.1+(larbin2.6.1@unspecified.mail)
larbin_2.6.2 (kabura@sushi.com)
larbin_2.6.2 (larbin2.6.2@unspecified.mail)
larbin_2.6.2 (listonatccdotgatechdotedu)
larbin_2.6.2 (vitalbox1@hotmail.com)
larbin_2.6.2 kabura@sushi.com
larbin_2.6.2 larbin@correa.org
larbin_2.6.2 larbin2.6.2@unspecified.mail
larbin_2.6.2 listonatccdotgatechdotedu
larbin_2.6.2 vitalbox1@hotmail.com
laycat
leechftp
lexibot
lexibotweb image collector
libcurl-agent
libweb/clshttp
libweb/clshttp
libwww
libwww-perl
libwww-perl/5.65
linkaider
linkextractorpro
linkextractorpro
linko
linkscan/8.1a unix
linkwalker
linkwalker/2.0
lmqueuebot/0.2
lnspiderguy
localbot
localcombot
looksmart
lwp-trivial
lwp-trivial/1.34
mail.ru
mantraagent
mass downloader
mass downloader/2.2
mata hari
mediapartners-google*
mfc_tear_sample
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
midown tool
miixpc
miixpc/4.2
missigua locator
mister pix
mister pix ii 2.01
mister pix ii 2.02a
mister pix version.dll
mixrankbot
mj12bot
mj12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+)
mj12bot/v1.2.0
mj12bot/v1.2.0 (http://majestic12.co.uk/bot.php? )
mlbot
modified gmmbotrighthere
moget
moget/2.1
moget/2.1 (moget@goo.ne.jp)
moozilla
mozilla/2.0 (compatible; ask jeeves/teoma)
mozilla/3
mozilla/4
mozilla/4.0
mozilla/4.0 (compatible; b-l-i-t-z-b-o-t)
mozilla/4.0 (compatible; bullseye; windows 95)
mozilla/4.0 (compatible; msie 4.0; windows 2000)
mozilla/4.0 (compatible; msie 4.0; windows 9
mozilla/4.0 (compatible; msie 4.0; windows 95)
mozilla/4.0 (compatible; msie 4.0; windows 98)
mozilla/4.0 (compatible; msie 4.0; windows nt)
mozilla/4.0 (compatible; msie 4.0; windows xp)
mozilla/4.0 (compatible; msie 5.0; windows 95) voilabot beta 1.2
mozilla/4.0 (compatible; msie 5.05; windows nt 3.51)
mozilla/4.0 (compatible; msie 5.05; windows nt 4.0)
mozilla/4.0 (compatible; msie 5.05; windows nt 5.0)
mozilla/4.0 (compatible; msie 6.0; windows nt 5.0)
mozilla/4.0+compatible+zyborg/1.0+
mozilla/5
mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
mozilla/5.0 (compatible; yahoo! slurp china; http://misc.yahoo.com.cn/help.html)
mozilla/5.0+(compatible;+becomebot/3.0;++http://www.become.com/site_owners.html)
msiecrawler
msnbot-media
msr-isrccrawler
nambu
nationaldirectory-superspider
naverbot
navroad
nearsite
nerdybot
net vampire
net vampire/3.0
netants
netants/1.10
netants/1.23
netants/1.24
netants/1.25
netmechanic
netspider
netzip
netzip downloader 1.0 win32(nov 12 1998)
netzip-downloader/1.0.62 (win32; dec 7 1998)
netzippy+(http://www.innerprise.net/usp-spider.asp)
nexen
nextgensearchbot
ng/2.0
nicebot
nicerspro
noxtrumbot/1.0
npbot
nutch
obot
ocelli
octopus
offline explorer
offline explorer/1.2
offline explorer/1.4
offline explorer/1.5
offline explorer/1.6
offline explorer/1.7
offline explorer/1.9
offline explorer/1.9
offline explorer/2.0
offline explorer/2.1
offline explorer/2.3
offline explorer/2.4
offline explorer/2.5
offline explorer/2.5
offline navigator
offline.explorer
omniexplorer
omniexplorer_bot
omniexplorer_bot/1.07
omniexplorer_bot/1.09
omniexplorer_bot/1.10
ontownsbot
oozbot
openbot
openfind
openfind data gathere
openx
oracle ultra search
orthogaffe
page_prefetcher
pagegrabber
panscient.com
papa foto
pavuk
pcbrowser
pecl::http
perl
perman
php/
phpcrawl
phpversion
piffany_web_cacher_v0.91
propowerbot/2.14
propowerbot/2.14
prowebwalker
prowebwalker
psbot
psbot/0.1
psbot/0.1+(+http://www.picsearch.com/bot.html)
psibots
python-urllib
python-urllib
qeavis
queryn metasearch
radiation retriever 1.1
rankivabot
realdownload
realdownload/4.0.0.40
realdownload/4.0.0.41
realdownload/4.0.0.42
reap-crawler
reget
repomonkey
repomonkey bait & tackle/v1.01
ricecomputerarchitecture
rma
robotgenius
robozilla
ru_com_viewer
rufusbot
sapphirewebcrawler
sbider
sbider/sbider-0.8.2-dev
scooter
scooter/2.0
scoutjet
scrubby
searchme
searchpreview
searchpreview
sensis web crawler
sensis web crawler (search_comments\\at\\sensis\\dot\\com\\dot\\au)
sensis+web+crawler+
servage
servagerobot
setooz
seznambot
shopwiki
sidewinder
sika
sitecat
sitecheck.internetseer.com
sitecheck.internetseer.com
sitemap: http://www.jaxcarpentry.com/sitemap.xml
sitesnagger
slicehost
slurp.so/1.0
slurp@inktomi
slurp@inktomi.com
slurp/2.0-kitehourly
slurp/2.0-owlweekly
slurp/2.0j
slurp/3.0-au
slysearch
slysearch/1.0
slysearch/1.x
smartdownload
smartdownload/1.2.76 (win32; apr 1 1999)
smartdownload/1.2.77 (win32; aug 17 1999)
smartdownload/1.2.77 (win32; feb 1 2000)
smartdownload/1.2.77 (win32; jun 19 2001)
snapbot
snapbot/1.0
snappreviewbot
snappy
snappybot
snoopy
sogou spider
sogou+spider
spankbot
spanner
speedy
speedyspider
sphsearch
sproose
sqworm/2.9.85-beta (beta_release; 20011115-775; i686-pc-linux
stackrambler/2.0
stackrambler/2.0+(msie+incompatible)
subgraph
subgraph vega
superbot
superbot/3.0 (win32)
superbot/3.1 (win32)
superbot/4.4.0.60 (windows xp)
superhttp
superhttp/1.0
superpages
surfbot
surveybot
surveybot/2.3
surveybot/2.3 (whois source)
suzuran
szukacz/1.4
szukacz/1.4
t-online browser
t-rex
takeout
teleport
teleport pro
teleport pro/1.29
teleport pro/1.29.1590
teleport pro/1.29.1634
teleport pro/1.29.1718
teleport pro/1.29.1820
teleport pro/1.29.1847
teleportpromiixpc
telesoft
teoma
the.intraformant
thenomad
therarestparser
tighttwatbot
titan
tocrawl/urldispatcher
trident
true_robot
true_robot /1.0turingos
true_robot/1.0
turingos
turnitinbot
turnitinbot/1.5
turnitinbot/2.0 http://www.turnitin.com/robot/crawlerinfo.html
tutorial crawler
twiceler
twiceler-0.9
twiceler-0.9+http://www.cuill.com/twiceler/robot.html
uberbot
ubicrawler
ultraseek
uri::fetch
url control
url_spider_pro
urllib
urly warning
uw_cse_xwc
vci
vci webviewer vci webviewer win32
vcivci
vega
violabot
voideye
voilabot
voyager
voyager/1.0
voyager/2.0
vscooter
vwbot
web downloader/4.5
web downloader/5.7
web downloader/6.9
web image collector
web sucker
web.image.collector
webalta
webaroobot
webauto
webauto/3.40 (win98; i)
webbandit
webbandit/3.50
webcapture 2.0
webcollage
webcopier
webcopier v.2.2
webcopier v2.5
webcopier v2.6
webcopier v2.7a
webcopier v2.8
webcopier v3.0
webcopier v3.0.1
webcopier v3.2
webcopier v3.2a
webcopier v3.2a
webcopier v3.3
webcopier v3.3.0
webcopier v3.3.2
webcrawler
webdatacentrebot
webemailextrac.*
webenhancer
webenhancer
webfetch
webfetch/2.1.0
webgo is
webleacher
webmasterworld extractor
webmasterworldforumbot
webreaper
webreaper [info@webreaper.net]
webreaper [webreaper@otway.com]
webreaper v9.1 - www.otway.com/webreaper
webreaper v9.7 - www.webreaper.net
webreaper v9.8 - www.webreaper.net
webreaper vwebreaper v7.3 – www.otway.com/webreaper
websauger
websauger 1.20b
websauger 1.20j
websauger 1.20k
websense
website extractor
website extractor (http://www.asona.org)
website quester
website quester - www.asona.org
website quester - www.esalesbiz.com/extra/
webspider
webster pro
webstripper
webstripper/2.03
webstripper/2.10
webstripper/2.12
webstripper/2.13
webstripper/2.15
webstripper/2.16
webstripper/2.19
webviewer
webwhacker
webzip
webzip/2.75 (http://www.spidersoft.com)
webzip/3.5 (http://www.spidersoft.com)
webzip/3.65 (http://www.spidersoft.com)
webzip/3.80 (http://www.spidersoft.com)
webzip/4.0
webzip/4.0 (http://www.spidersoft.com)
webzip/4.1 (http://www.spidersoft.com)
webzip/4.21
webzip/4.21 (http://www.spidersoft.com)
webzip/5.0
webzip/5.0 (http://www.spidersoft.com)
webzip/5.0 pr1 (http://www.spidersoft.com)
wells search ii
wep search
wget
wget
wget/1.10.2
wget/1.5.2
wget/1.5.3
wget/1.5.3
wget/1.6
wget/1.6
wget/1.7
wget/1.8
wget/1.8.1
wget/1.8.1+cvs
wget/1.8.2
wget/1.9-beta
wget/1.9.1
wget/1.9+cvs-stable (red hat modified)
whois.de
whoisde.de
widow
willybot
win32
worio
www-collector-e
wwwoffle
xaldon webspider
xaldon webspider 2.5.b3
xenu
xenu link sleuth
xenu link sleuth 1.2i
xenu's
xenu's link sleuth 1.1c
xenu's link sleuth 1.1c
y!j
y!j-bsc
y!j-bsc
y!j-bsc/1.0
y!j-bsc/1.0 (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
y!j/1.0
yahoo-blogs
yahoo-blogs/v3.9
yahoo-mmcrawler/3.x
yahooseeker
yahooseeker-testing/v3.9 (compatible; mozilla 4.0; msie 5.5; http://search.yahoo.com/)
yahooysmcm
yahooysmcm/2.0.0
yandeximages
yandex
yandex/1.01.001 (compatible; win16; h)
yandex/1.01.001 (compatible; win16; i)
yandex/1.01.001 (compatible; win16; m)
yandex/1.01.001 (compatible; win16; p)
yandexsomething
yandexsomething/1.0
yanga
yeti
yooglifetchagent/0.1
youdaobot
zao
zealbot
zend_http_client
zermelo
zeus
zeus 11389 webster pro v2.9 win32
zeus 11652 webster pro v2.9 win32
zeus 18018 webster pro v2.9 win32
zeus 26378 webster pro v2.9 win32
zeus 30747 webster pro v2.9 win32
zeus 32297 webster pro v2.9 win32
zeus 32297 webster pro v2.9 win32
zeus 39206 webster pro v2.9 win32
zeus 41641 webster pro v2.9 win32
zeus 44238 webster pro v2.9 win32
zeus 51070 webster pro v2.9 win32
zeus 51674 webster pro v2.9 win32
zeus 51837 webster pro v2.9 win32
zeus 63567 webster pro v2.9 win32
zeus 6694 webster pro v2.9 win32
zeus 71129 webster pro v2.9 win32
zeus 82016 webster pro v2.9 win32
zeus 82900 webster pro v2.9 win32
zeus 84842 webster pro v2.9 win32
zeus 90872 webster pro v2.9 win32
zeus 94934 webster pro v2.9 win32
zeus 95245 webster pro v2.9 win32
zeus 95351 webster pro v2.9 win32
zeus 97371 webster pro v2.9 win32
zeus link scout
zibber
zibber v0.1
zibber-v0.1(www.zibb.com/crawler/)
zupeecrawler
zyborg
zyborg
zyborg/1.0

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://paixaoporfut.com/page-sitemap.xml
sitemap https://paixaoporfut.com/post-sitemap.xml
sitemap https://paixaoporfut.com/category-sitemap.xml
Back to top

Comments

  • Define website sitemaps
  • Sitemap: https://dominio/video-sitemap.xml
  • Sitemap: https://dominio/image-sitemap.xml
  • o que tiver partindo do sitemap_index.xml
  • Previne problemas de recursos bloqueados no Google Webmaster Tools
  • Disallow: */?add_to_wishlist=*
  • Disallow: */?add-to-cart=*
  • Disallow: */?max_price*
  • Disallow: */?max_price*
  • Disallow: */?min_price*
  • Disallow: */?s=*
  • Disallow: */carrinho
  • Disallow: */finalizar-compra
  • Disallow: /verificacao-de-e-mail/
  • Disallow:/*/politica-de-privacidade/*
  • pode colocar páginas que não vão entrar
  • Não rastrear arquivos de backup-copias de segurança etc
  • Disallow: */?add_to_wishlist=*
  • Disallow: */?add-to-cart=*
  • Disallow: */?max_price*
  • Disallow: */?max_price*
  • Disallow: */?min_price*
  • Disallow: */?s=*
  • Disallow: */carrinho
  • Disallow: */finalizar-compra
  • Disallow: /verificacao-de-e-mail/
  • pode colocar páginas que não vão entrar
  • Bloqueio de trackbacks
  • Bloqueio de feeds para crawlers
  • paginacion
  • htmlparavirusjapones
  • Proibe accesso a bots não necessários
Back to top

Warnings

  • 5 invalid lines.
Back to top