Log In Sign Up

miamicondolifestyle.com
robots.txt

Robots Exclusion Standard data for miamicondolifestyle.com

Resource Scan

Scan Details

Site Domain miamicondolifestyle.com
Base Domain miamicondolifestyle.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-19T04:12:27+00:00
Next Scan 2024-10-18T04:12:27+00:00

Last Successful Scan

Scanned2024-06-21T04:09:05+00:00
URL https://miamicondolifestyle.com/robots.txt
Redirect https://www.miamicondolifestyle.com/robots.txt
Redirect Domain www.miamicondolifestyle.com
Redirect Base miamicondolifestyle.com
Domain IPs 104.26.10.251, 104.26.11.251, 172.67.70.66, 2606:4700:20::681a:afb, 2606:4700:20::681a:bfb, 2606:4700:20::ac43:4642
Redirect IPs 104.26.10.251, 104.26.11.251, 172.67.70.66, 2606:4700:20::681a:afb, 2606:4700:20::681a:bfb, 2606:4700:20::ac43:4642
Response IP 172.67.70.66
Found Yes
Hash d22a8a8517b70a0e25297866c944243169f3ae5883c013eca8f6b9cf7520833f
SimHash 13945710054b

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

feed

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sift

Rule Path
Disallow /

crawl

Rule Path
Disallow /

applebot

Rule Path
Disallow /

asynchttpclient

Rule Path
Disallow /

baidu

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bbot

Rule Path
Disallow /

bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

custo

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

elinks

Rule Path
Disallow /

exabot

Rule Path
Disallow /

facebook

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

fetcher

Rule Path
Disallow /

firefox

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

grub

Rule Path
Disallow /

infobot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

java

Rule Path
Disallow /

jeeves

Rule Path
Disallow /

konqueror

Rule Path
Disallow /

link

Rule Path
Disallow /

linkbot

Rule Path
Disallow /

links

Rule Path
Disallow /

magpie

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

motor

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

nutch

Rule Path
Disallow /

obot

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

proximic

Rule Path
Disallow /

python

Rule Path
Disallow /

rambler

Rule Path
Disallow /

seek

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

spider

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

wget

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yahoo link preview

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.miamicondolifestyle.com/sitemap.xml
sitemap https://www.miamicondolifestyle.com/images_sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top