Log In Sign Up

growthafiliados.com.br
robots.txt

Robots Exclusion Standard data for growthafiliados.com.br

Resource Scan

Scan Details

Site Domain growthafiliados.com.br
Base Domain growthafiliados.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-20T17:19:49+00:00
Next Scan 2024-12-19T17:19:49+00:00

Last Successful Scan

Scanned2022-09-14T07:25:41+00:00
URL https://growthafiliados.com.br/robots.txt
Response IP 140.82.30.235
Found Yes
Hash e3b90a91146f24f8f9cb1049f03e8261c7ec49e2e848c67add51085caf56a547
SimHash a895107066c0

Groups

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seo spider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

alexawebsearchplatform

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

betabot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

crawl

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

infoseek sidewinder

Rule Path
Disallow /

linkchecker

Rule Path
Disallow /

netsongbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dataforseo-bot

Rule Path
Disallow /

mj12bot/

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

feedspot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

feedspot/1.0

Rule Path
Disallow /

keybot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

feedspot

Rule Path
Disallow /

checkhost

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

hrefs

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

gdnplus.com

Rule Path
Disallow /

online-webceo-bot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

mecrawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-urllib/2.7

Rule Path
Disallow /

curl/7.35.0

Rule Path
Disallow /

wp_is_mobile

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

java/11.0.10

Rule Path
Disallow /

photon

Rule Path
Disallow /

photon/1.0

Rule Path
Disallow /

serendeputybot

Rule Path
Disallow /

webpage-inspector.com

Rule Path
Disallow /

twingly recon

Rule Path
Disallow /

bidtellect/0.0.958.0

Rule Path
Disallow /

slackbot-linkexpanding 1.0

Rule Path
Disallow /

df bot 1.0

Rule Path
Disallow /

who.is bot

Rule Path
Disallow /

semrush bot

Rule Path
Disallow /

sem rush bot

Rule Path
Disallow /

yandex bot

Rule Path
Disallow /

sogou bot

Rule Path
Disallow /

majestic bot

Rule Path
Disallow /

exalead bot

Rule Path
Disallow /

baidu bot

Rule Path
Disallow /

ahrefs bot

Rule Path
Disallow /

mediamathbot/1.0

Rule Path
Disallow /

trendictionbot0

Rule Path
Disallow /

omgili/0.5

Rule Path
Disallow /

iframely

Rule Path
Disallow /

cortex/1.0

Rule Path
Disallow /

trendictionbot0.5.0

Rule Path
Disallow /

domains project/1.3.7

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mediamathbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /email/
Disallow /session
Disallow /user-api-key
Disallow /*?api_key*
Disallow /*?*api_key*
Disallow /badges
Disallow /u/
Disallow /my
Disallow /search
Disallow /tag/*/l
Disallow /g
Disallow /t/*/*.rss
Disallow /c/*.rss
Disallow /docs/

googlebot

Rule Path
Disallow /admin/
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /email/
Disallow /session
Disallow /user-api-key
Disallow /*?api_key*
Disallow /*?*api_key*
Back to top

Other Records

Field Value
sitemap https://growthafiliados.com.br/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
Back to top