Log In Sign Up

amoportugal.pt
robots.txt

Robots Exclusion Standard data for amoportugal.pt

Resource Scan

Scan Details

Site Domain amoportugal.pt
Base Domain amoportugal.pt
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-19T22:35:27+00:00
Next Scan 2024-10-17T22:35:27+00:00

Last Successful Scan

Scanned2023-11-30T17:39:58+00:00
URL https://amoportugal.pt/robots.txt
Domain IPs 130.185.87.212
Response IP 130.185.87.212
Found Yes
Hash d15acbc2bcb9b6e76114b9e2147f4e677b69b3ed189bb792d7ed0f1edff1c9a1
SimHash 2b5956f149a1

Groups

aboundexbot

Product Comment
aboundexbot http://www.aboundex.com/crawler/
Rule Path
Disallow /

advbot

Product Comment
advbot http://advbot.org/bot.html
Rule Path
Disallow /

ahrefsbot

Product Comment
ahrefsbot http://ahrefs.com/robot/
Rule Path
Disallow /

alphaseobot

Product Comment
alphaseobot http://alphaseobot.com/bot.html
Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

Product Comment
bingbot http://www.bing.com/bingbot.htm
Rule Path
Disallow /

bluerobot

Product Comment
bluerobot http://www.bluerobot.info/
Rule Path
Disallow /

bubing

Product Comment
bubing http://law.di.unimi.it/BUbiNG.html
Rule Path
Disallow /

careerbot

Product Comment
careerbot http://www.career-x.de/bot.html
Rule Path
Disallow /

catchbot

Product Comment
catchbot http://www.catchbot.com
Rule Path
Disallow /

cazoodlebot

Product Comment
cazoodlebot http://www.cazoodle.com/cazoodlebot/
Rule Path
Disallow /

ccbot

Product Comment
ccbot http://www.commoncrawl.org/bot.html
Rule Path
Disallow /

charlotte

Product Comment
charlotte http://www.searchme.com/support/
Rule Path
Disallow /

discobot

Product Comment
discobot http://discoveryengine.com/discobot.html
Rule Path
Disallow /

domaindb

Product Comment
domaindb http://domaindb.com/crawler/
Rule Path
Disallow /

dotbot

Product Comment
dotbot http://www.dotnetdotcom.org/
Rule Path
Disallow /

euripbot

Product Comment
euripbot http://www.eurip.com/service/webmaster/euripbot.html
Rule Path
Disallow /

exabot

Product Comment
exabot http://www.exabot.com/go/robot
Rule Path
Disallow /

gaisbot

Product Comment
gaisbot http://gais.cs.ccu.edu.tw/robot.php
Rule Path
Disallow /

gigabot

Product Comment
gigabot http://www.gigablast.com/spider.html
Rule Path
Disallow /

robots-gnomit

Product Comment
robots-gnomit http://www.gnomit.com/
Rule Path
Disallow /

gurujibot

Product Comment
gurujibot http://www.guruji.com/en/WebmasterFAQ.html
Rule Path
Disallow /

kalooga

Product Comment
kalooga http://www.kalooga.com/info.html?page=crawler
Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

meanpathbot

Product Comment
meanpathbot https://meanpath.com/meanpathbot.html
Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Product Comment
mlbot http://www.metadatalabs.com/mlbot/
Rule Path
Disallow /

msnbot
msnbot

Product Comment
msnbot http://search.msn.com/msnbot.htm
Rule Path
Disallow /

netresearchserver

Product Comment
netresearchserver http://www.loopip.com/robot.html
Rule Path
Disallow /

oozbot

Product Comment
oozbot http://www.setooz.com/oozbot.html
Rule Path
Disallow /

openisearch

Product Comment
openisearch http://www.openisearch.com/faq.html
Rule Path
Disallow /

piplbot

Product Comment
piplbot https://pipl.com/bot/
Rule Path
Disallow /

plukkie

Product Comment
plukkie http://www.botje.com/plukkie.htm
Rule Path
Disallow /

proximic

Product Comment
proximic http://www.proximic.com/info/spider.php
Rule Path
Disallow /

psbot

Rule Path
Disallow /

sapphirewebcrawler

Product Comment
sapphirewebcrawler http://boston.lti.cs.cmu.edu/crawler/
Rule Path
Disallow /

search17

Product Comment
search17 http://www.search17.com/bot.php
Rule Path
Disallow /

seekportbot

Product Comment
seekportbot https://bot.seekport.com/
Rule Path
Disallow /

semrushbot

Product Comment
semrushbot https://pt.semrush.com/bot/
Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Product Comment
seznambot http://fulltext.seznam.cz/
Rule Path
Disallow /

slurp

Product Comment
slurp http://help.yahoo.com/help/us/ysearch/slurp
Rule Path
Disallow /

smtbot

Product Comment
smtbot http://www.similartech.com/smtbot
Rule Path
Disallow /

spbot

Product Comment
spbot http://openlinkprofiler.org/bot
Rule Path
Disallow /

speedy

Rule Path
Disallow /

sistrix

Product Comment
sistrix http://crawler.sistrix.net/
Rule Path
Disallow /

teoma

Product Comment
teoma http://about.ask.com/en/docs/about/webmasters.shtml
Rule Path
Disallow /

touche

Product Comment
touche http://www.touche.com.ve
Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler.

Product Comment
twiceler. http://www.cuil.com/twiceler/robot.html
Rule Path
Disallow /

urlfan-bot

Product Comment
urlfan-bot http://www.urlfan.com/site/bot/350.html
Rule Path
Disallow /

voilabot beta 1.2

Rule Path
Disallow /

wbsearchbot

Product Comment
wbsearchbot http://www.warebay.com/bot.html
Rule Path
Disallow /

webtraq

Product Comment
webtraq http://85.17.49.65/
Rule Path
Disallow /

wotbox

Product Comment
wotbox http://www.wotbox.com/bot/
Rule Path
Disallow /

yandex

Rule Path
Disallow /

yesupbot

Product Comment
yesupbot http://www.yesup.net/bot.html
Rule Path
Disallow /

yodaobot

Product Comment
yodaobot http://www.youdao.com/help/webmaster/spider/
Rule Path
Disallow /

*

Rule Path
Disallow /*?*
Disallow /?*
Disallow /2*
Disallow /b*
Disallow /e*
Disallow /r*
Disallow /g*
Disallow /i*
Disallow /n*
Disallow /t*
Disallow /administrator/
Disallow /blog/
Disallow /cache/
Disallow /components/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /media/
Disallow /modules/
Disallow /phpbb/
Disallow /phplist/
Disallow /plugins/
Disallow /private/
Disallow /spam/
Disallow /templates/
Disallow /temp/
Disallow /tmp/
Disallow /wordpress/
Disallow /wp/
Disallow /wp-login/
Disallow /xmlrpc/
Back to top