Log In Sign Up

buildtrack.in
robots.txt

Robots Exclusion Standard data for buildtrack.in

Resource Scan

Scan Details

Site Domain buildtrack.in
Base Domain buildtrack.in
Scan Status Ok
Last Scan2024-09-22T09:31:27+00:00
Next Scan 2024-10-22T09:31:27+00:00

Last Scan

Scanned2024-09-22T09:31:27+00:00
URL https://buildtrack.in/robots.txt
Redirect https://www.buildtrack.in/robots.txt
Redirect Domain www.buildtrack.in
Redirect Base buildtrack.in
Domain IPs 65.1.235.134
Redirect IPs 65.1.235.134
Response IP 65.1.235.134
Found Yes
Hash adc1900227c5aa8debecc474b24c3b5ebabc69f8bf8860ca657db3b892b13dda
SimHash 634bf2672397

Groups

robozilla

Rule Path
Disallow

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Allow /news/page/1/
Allow /news/wp-includes/js/
Disallow /brochure/
Disallow /download/case-studies/
Disallow /php/request-demo-smtp.php
Disallow /cgi-bin/
Disallow /kamalav3/
Disallow /omaxe/
Disallow /prishaindia/
Disallow /trial/
Disallow /demo3/
Disallow /ackrutinew/
Disallow /greentrack/
Disallow /RiverPark/
Disallow /news/comments/feed/
Disallow /BACKUP/
Disallow /beta/
Disallow /php/
Disallow /PHPMailer/
Disallow /fonts/
Disallow /images-jpg/
Disallow /includes/
Disallow /font-icons/
Disallow /download/BT_Smart_App_User_Manual_Godrej.pdf

*

Rule Path
Disallow /BtRebo/

*

Rule Path
Disallow /cgi-bin/

abonti

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aibot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

alligator

Rule Path
Disallow /

allsubmitter

Rule Path
Disallow /

angloinfo

Rule Path
Disallow /

antelope

Rule Path
Disallow /

apexoo

Rule Path
Disallow /

asterias

Rule Path
Disallow /

attach

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

backstreet

Rule Path
Disallow /

backweb

Rule Path
Disallow /

badass

Rule Path
Disallow /

baid

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bandit

Rule Path
Disallow /

batchftp

Rule Path
Disallow /

bbbike

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

bigfoot

Rule Path
Disallow /

billigerbot

Rule Path
Disallow /

binlar

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

black.hole

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blow

Rule Path
Disallow /

blowfish

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

bolt\ 0

Rule Path
Disallow /

bot\ for\ jce

Rule Path
Disallow /

bot\ mailto\:craftbot@yahoo\.com

Rule Path
Disallow /

botalot

Rule Path
Disallow /

buddy

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

bullseye

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

casper

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cegbfeieh

Rule Path
Disallow /

checkprivacy

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

chromeframe

Rule Path
Disallow /

clerkbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

clshttp

Rule Path
Disallow /

cogentbot

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

collector

Rule Path
Disallow /

commoncrawler

Rule Path
Disallow /

comodo

Rule Path
Disallow /

copier

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

cpython

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

crawlera

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

crescent

Rule Path
Disallow /

cshttp

Rule Path
Disallow /

curious

Rule Path
Disallow /

curl

Rule Path
Disallow /

custo

Rule Path
Disallow /

cws_proxy

Rule Path
Disallow /

default\ browser\ 0

Rule Path
Disallow /

demon

Rule Path
Disallow /

deusu

Rule Path
Disallow /

devil

Rule Path
Disallow /

diavol

Rule Path
Disallow /

digext

Rule Path
Disallow /

digincore

Rule Path
Disallow /

diibot

Rule Path
Disallow /

disco

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

docomo

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

download.demon

Rule Path
Disallow /

download.devil

Rule Path
Disallow /

download.wonder

Rule Path
Disallow /

download\ demo

Rule Path
Disallow /

dragonfly

Rule Path
Disallow /

drip

Rule Path
Disallow /

dts.agent

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

easydl

Rule Path
Disallow /

ebingbong

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

ecxi

Rule Path
Disallow /

eirgrabber

Rule Path
Disallow /

elmer

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exaleadcloudview

Rule Path
Disallow /

expertsearch

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

express

Rule Path
Disallow /

express\ webpictures

Rule Path
Disallow /

extract

Rule Path
Disallow /

extractor

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

eyenetie

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

f2s

Rule Path
Disallow /

fastseek

Rule Path
Disallow /

feedfinder

Rule Path
Disallow /

feedlybot

Rule Path
Disallow /

fhscan

Rule Path
Disallow /

finbot

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

flappybot

Rule Path
Disallow /

flashget

Rule Path
Disallow /

flicky

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

flunky

Rule Path
Disallow /

foobot

Rule Path
Disallow /

frontpage

Rule Path
Disallow /

g00g1e

Rule Path
Disallow /

galaxybot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

genieo

Rule Path
Disallow /

getright

Rule Path
Disallow /

getweb\!

Rule Path
Disallow /

gigablastopensource

Rule Path
Disallow /

go\-ahead\-got\-it

Rule Path
Disallow /

go\!zilla

Rule Path
Disallow /

gotit

Rule Path
Disallow /

gozaikbot

Rule Path
Disallow /

grab

Rule Path
Disallow /

grabber

Rule Path
Disallow /

grabnet

Rule Path
Disallow /

grafula

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

gt\:\:www

Rule Path
Disallow /

gtb5

Rule Path
Disallow /

guzzle

Rule Path
Disallow /

harvest

Rule Path
Disallow /

harvest

Rule Path
Disallow /

headmasterseo

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

hloader

Rule Path
Disallow /

hmview

Rule Path
Disallow /

homepagebot

Rule Path
Disallow /

htmlparser

Rule Path
Disallow /

http\:\:lite

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

humanlinks

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

icarus6

Rule Path
Disallow /

id\-search

Rule Path
Disallow /

idbot

Rule Path
Disallow /

ilsebot

Rule Path
Disallow /

image.stripper

Rule Path
Disallow /

image.sucker

Rule Path
Disallow /

image\ stripper

Rule Path
Disallow /

image\ sucker

Rule Path
Disallow /

imagefetch

Rule Path
Disallow /

indigonet

Rule Path
Disallow /

indy\ library

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

infotekies

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

intelliseek

Rule Path
Disallow /

interget

Rule Path
Disallow /

internet\ ninja

Rule Path
Disallow /

internetseer\.com

Rule Path
Disallow /

iria

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

isc\ systems\ irc\ search\ 2\.1

Rule Path
Disallow /

jakarta

Rule Path
Disallow /

jakarta

Rule Path
Disallow /

java

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

jetcar

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

joc

Rule Path
Disallow /

joc\ web\ spider

Rule Path
Disallow /

jooblebot

Rule Path
Disallow /

justview

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

kanagawa

Rule Path
Disallow /

kenjin.spider

Rule Path
Disallow /

keyword.density

Rule Path
Disallow /

kingspider

Rule Path
Disallow /

kmccrew

Rule Path
Disallow /

larbin

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

leechget

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

lftp

Rule Path
Disallow /

libweb

Rule Path
Disallow /

libwww

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

likse

Rule Path
Disallow /

lingewoud

Rule Path
Disallow /

linkchecker

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkscan

Rule Path
Disallow /

linkscrawler

Rule Path
Disallow /

linksmanager\.com_bot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

linqiarssbot

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

lubbersbot

Rule Path
Disallow /

lwp\-trivial

Rule Path
Disallow /

mag-net

Rule Path
Disallow /

magnet

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

majestic12

Rule Path
Disallow /

markwatch

Rule Path
Disallow /

mass.downloader

Rule Path
Disallow /

mass\ downloader

Rule Path
Disallow /

masscan

Rule Path
Disallow /

mata.hari

Rule Path
Disallow /

maverick

Rule Path
Disallow /

maxthon$

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

memo

Rule Path
Disallow /

metauri

Rule Path
Disallow /

mfc_tear_sample

Rule Path
Disallow /

microsoft\ url\ control

Rule Path
Disallow /

microsoft\.url

Rule Path
Disallow /

midown\ tool

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

miner

Rule Path
Disallow /

missigua\ locator

Rule Path
Disallow /

mister\ pix

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mozilla.*indy

Rule Path
Disallow /

mozilla.*newt

Rule Path
Disallow /

msfrontpage

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

nameprotect

Rule Path
Disallow /

navroad

Rule Path
Disallow /

nearsite

Rule Path
Disallow /

net\ vampire

Rule Path
Disallow /

netants

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

netestate

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

netspider

Rule Path
Disallow /

netzip

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

niki\-bot

Rule Path
Disallow /

nimblecrawler

Rule Path
Disallow /

nimbostratus\-bot

Rule Path
Disallow /

ninja

Rule Path
Disallow /

nmap

Rule Path
Disallow /

nmap

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

octopus

Rule Path
Disallow /

offline\.explorer

Rule Path
Disallow /

offline\.navigator

Rule Path
Disallow /

offline\ explorer

Rule Path
Disallow /

offline\ navigator

Rule Path
Disallow /

openfind

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

openlinkprofiler

Rule Path
Disallow /

openwebspider

Rule Path
Disallow /

orangebot

Rule Path
Disallow /

outfoxbot

Rule Path
Disallow /

owlin

Rule Path
Disallow /

pagegrabber

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

panopta

Rule Path
Disallow /

panscient\.com

Rule Path
Disallow /

papa\ foto

Rule Path
Disallow /

pavuk

Rule Path
Disallow /

pcbrowser

Rule Path
Disallow /

pecl\:\:http

Rule Path
Disallow /

peoplepal

Rule Path
Disallow /

photon

Rule Path
Disallow /

phpcrawl

Rule Path
Disallow /

pixray

Rule Path
Disallow /

planetwork

Rule Path
Disallow /

pleasecrawl

Rule Path
Disallow /

pnamain\.exe

Rule Path
Disallow /

pockey

Rule Path
Disallow /

podcastpartybot

Rule Path
Disallow /

prijsbest

Rule Path
Disallow /

probethenet

Rule Path
Disallow /

propowerbot

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

pump

Rule Path
Disallow /

purebot

Rule Path
Disallow /

pycurl

Rule Path
Disallow /

python\-requests

Rule Path
Disallow /

queryn\.metasearch

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

r6_feedfetcher

Rule Path
Disallow /

realdownload

Rule Path
Disallow /

reaper

Rule Path
Disallow /

recorder

Rule Path
Disallow /

reget

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

riddler

Rule Path
Disallow /

ripper

Rule Path
Disallow /

rippers\ 0

Rule Path
Disallow /

rma

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rssingbot

Rule Path
Disallow /

rv\:1\.9\.1

Rule Path
Disallow /

ryzecrawler

Rule Path
Disallow /

safesearch

Rule Path
Disallow /

sbider

Rule Path
Disallow /

scanbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

screaming

Rule Path
Disallow /

seamonkey$

Rule Path
Disallow /

search_robot

Rule Path
Disallow /

search\.goo\.ne\.jp

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks\-robot

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

sightupbot

Rule Path
Disallow /

siphon

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitecheck\.internetseer\.com

Rule Path
Disallow /

siteexplorer\.info

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

skygrid

Rule Path
Disallow /

slackbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

snake

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spacebison

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

spaumbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spinn4r

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

steeler

Rule Path
Disallow /

stripper

Rule Path
Disallow /

sucker

Rule Path
Disallow /

sucker

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

superhttp

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

szukacz

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleport\ pro

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

the\.intraformant

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

tighttwatbot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

tineye\-bot

Rule Path
Disallow /

titan

Rule Path
Disallow /

toata\ dragostea\ mea\ pentru\ diavola

Rule Path
Disallow /

toplistbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

turingos

Rule Path
Disallow /

turnit

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

uri\:\:fetch

Rule Path
Disallow /

urllib

Rule Path
Disallow /

urly\.warning

Rule Path
Disallow /

vacuum

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

vci

Rule Path
Disallow /

vidiblescraper

Rule Path
Disallow /

vikspider

Rule Path
Disallow /

voideye

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

wallpapershd

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

web.image.collector

Rule Path
Disallow /

web\ image\ collector

Rule Path
Disallow /

web\ sucker

Rule Path
Disallow /

webalta

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webcollage

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webfuck

Rule Path
Disallow /

webgo\ is

Rule Path
Disallow /

webleacher

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

webpix

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webshag

Rule Path
Disallow /

website\.extractor

Rule Path
Disallow /

website\ extractor

Rule Path
Disallow /

website\ quester

Rule Path
Disallow /

webster

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websucker

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wells\ search\ ii

Rule Path
Disallow /

wep\ search

Rule Path
Disallow /

wesee

Rule Path
Disallow /

wget

Rule Path
Disallow /

whack

Rule Path
Disallow /

whacker

Rule Path
Disallow /

widow

Rule Path
Disallow /

winhttrack

Rule Path
Disallow /

wininet

Rule Path
Disallow /

wisenutbot

Rule Path
Disallow /

woobot

Rule Path
Disallow /

woopingbot

Rule Path
Disallow /

worldwebheritage.org

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wpscan

Rule Path
Disallow /

www\-collector\-e

Rule Path
Disallow /

www\-mechanize

Rule Path
Disallow /

wwwoffle

Rule Path
Disallow /

xaldon

Rule Path
Disallow /

xaldon\ webspider

Rule Path
Disallow /

xenu

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zade

Rule Path
Disallow /

zermelo

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zh\-cn

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.buildtrack.in/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top