Log In Sign Up

dixiponto.com.br
robots.txt

Robots Exclusion Standard data for dixiponto.com.br

Resource Scan

Scan Details

Site Domain dixiponto.com.br
Base Domain dixiponto.com.br
Scan Status Ok
Last Scan2024-06-04T10:24:21+00:00
Next Scan 2024-07-04T10:24:21+00:00

Last Scan

Scanned2024-06-04T10:24:21+00:00
URL https://dixiponto.com.br/robots.txt
Domain IPs 3.211.97.93, 34.225.86.181, 35.153.155.30, 35.170.130.157, 44.198.43.200, 52.1.8.255
Response IP 3.211.97.93
Found Yes
Hash a5d1d69b83f6ff1bf02d4112f6e49ef795fa33b35ed300900ea2cfccf0f24d79
SimHash 54495e405010

Groups

*

Rule Path
Allow

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

mediapartners-google

Rule Path
Allow

adsbot-google

Rule Path
Allow

*

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

borneobot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

com.tinyspeck.chatlyio

Rule Path
Disallow /

duckduckbot-https

Rule Path
Disallow /

e.ventures\ investment\ crawler

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

gather\ analyze\ provide

Rule Path
Disallow /

gluten\ free\ crawler

Rule Path
Disallow /

healthcheckbot

Rule Path
Disallow /

http\ banner\ detection

Rule Path
Disallow /

hubspot\ links\ crawler

Rule Path
Disallow /

hypestat

Rule Path
Disallow /

internet-structure-research-project-bot

Rule Path
Disallow /

iodc;\ odysseus

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

lightspeedsystemscrawler

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

masscan

Rule Path
Disallow /

masscan

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

netestate\ ne\ crawler

Rule Path
Disallow /

netsystemsresearch

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

nsrbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

probethenet

Rule Path
Disallow /

riddler

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

seekport\ crawler

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

slack-imgproxy

Rule Path
Disallow /

slackbot

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

sogou\ web\ spider

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

tpradstxtcrawler

Rule Path
Disallow /

trendsmapresolver

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

unfurlist

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Warnings

  • 4 invalid lines.
Back to top