Log In Sign Up

assets.buildzoom.com
robots.txt

Robots Exclusion Standard data for assets.buildzoom.com

Resource Scan

Scan Details

Site Domain assets.buildzoom.com
Base Domain buildzoom.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-19T11:48:23+00:00
Next Scan 2024-06-17T11:48:23+00:00

Last Successful Scan

Scanned2022-11-17T02:40:45+00:00
URL https://assets.buildzoom.com/robots.txt
Response IP 13.224.189.69, 13.224.189.14, 13.224.189.100, 13.224.189.61
Found Yes
Hash f5f00a49ed11e8b0304f88e97b0ee730f77d7fe166ff49c36f271e0be332bd09
SimHash b24461424996

Groups

*

Rule Path
Allow /

blexbot

Rule Path
Disallow /

magpierss

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yandex

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

q2abot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

maxpointcrawler/nutch-1.1

Rule Path
Disallow /

maxpointcrawler/nutch

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

hyipcommander

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

biggerbetter

Rule Path
Disallow /

exabot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

woobot

Rule Path
Disallow /

coralwebprx

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

experbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

a6-indexer/1.0

Rule Path
Disallow /

a6-indexer

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

urlappendbot/1.0

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

netseer crawler

Rule Path
Disallow /

netseer

Rule Path
Disallow /

netseercrawler

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

betabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /
Back to top

Comments

  • Disallow: /api/v2/images/property/*
  • Disallow: /api/v1/contractor/*/building_permit_locations
  • Files
Back to top

Warnings

  • 5 invalid lines.
Back to top