Log In Sign Up

indotrading.com
robots.txt

Robots Exclusion Standard data for indotrading.com

Resource Scan

Scan Details

Site Domain indotrading.com
Base Domain indotrading.com
Scan Status Ok
Last Scan2024-06-25T18:16:43+00:00
Next Scan 2024-07-02T18:16:43+00:00

Last Scan

Scanned2024-06-25T18:16:43+00:00
URL https://indotrading.com/robots.txt
Redirect https://www.indotrading.com/robots.txt
Redirect Domain www.indotrading.com
Redirect Base indotrading.com
Domain IPs 47.241.13.254
Redirect IPs 47.241.13.254
Response IP 47.241.13.254
Found Yes
Hash 938867ae6dca700c593e03bc1e953e7cd07465574d56d1b991309609fd089849
SimHash 5158da60ed9e

Groups

*

Rule Path
Allow /

gptbot

Product Comment
gptbot OpenAI
Rule Path
Disallow /

chatgpt

Product Comment
chatgpt OpenAI
Rule Path
Disallow /

chatgpt-user

Product Comment
chatgpt-user OpenAI
Rule Path
Disallow /

openai

Product Comment
openai OpenAI
Rule Path
Disallow /

google-extended

Product Comment
google-extended Google Bard
Rule Path
Disallow /

adidxbot

Product Comment
adidxbot AdIdxbot
Rule Path
Disallow /

facebookbot

Product Comment
facebookbot Facebook bot
Rule Path
Disallow /

facebot

Product Comment
facebot Facebook bot
Rule Path
Disallow /

twitterbot

Product Comment
twitterbot Twitter bot
Rule Path
Disallow /

ccbot

Product Comment
ccbot Commoncrawl
Rule Path
Disallow /

claudebot

Product Comment
claudebot Claude Bot
Rule Path
Disallow /

criteobot/0.1

Product Comment
criteobot/0.1 Criteo Bot
Rule Path
Disallow /

alexabot

Product Comment
alexabot Alexabot
Rule Path
Disallow /

ia_archiver

Product Comment
ia_archiver Internet Archive
Rule Path
Disallow /

alexa site audit

Product Comment
alexa site audit Alexa audit crawler
Rule Path
Disallow /

anthropic-ai

Product Comment
anthropic-ai Anthropic
Rule Path
Disallow /

bytespider

Product Comment
bytespider ByteDance
Rule Path
Disallow /

omgili

Product Comment
omgili Webz.io
Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

nutch

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

metainspector

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

slurp

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

feedonomics

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

eyemonit uptime bot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

exabot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

ias crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

pingdom.com_bot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

expo9

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

www.admantx.com/service-fetcher.html

Rule Path
Disallow /

mozilla/5.0 muhstik-scan

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /msg.aspx
Disallow /message.aspx*
Disallow /searchkeyword.aspx*
Disallow /7052721*
Disallow /reporterr.aspx*
Disallow /reporterr-eng.aspx*
Disallow /templates/pinjaman/uob.aspx*
Disallow /aboutus.aspx*
Disallow /msg-eng.aspx
Disallow /karir.aspx*
Disallow /reg1.aspx*
Disallow /elmah.axd*
Disallow /forgetpassword-eng.aspx
Disallow /forgetpassword.aspx
Disallow /tipeakunpenjual.aspx*
Disallow /reg1.aspx
Disallow /partner.aspx
Disallow /Lb1kFn*
Disallow /UzCkse*
Disallow /loginajax.aspx*
Disallow /login.aspx*
Disallow /reg1.aspx*
Disallow /CaptchaImage.aspx*
Disallow /askproduct.aspx*
Disallow /tnooudnf*
Disallow /tNoouDnf*
Disallow /applyjob.aspx*
Disallow /jtpbiq*
Disallow /jtpBIQ*
Disallow /verifyemail.aspx
Disallow /showcase/032
Disallow /bogor/showcase/ly
Disallow /rfqdetail*
Disallow /showcase/gjfduum
Disallow /company/ezshop1
Disallow /showcase/762
Disallow /merek/hayward/hayward/
Disallow /AjaxMethod.asmx*
Disallow /m/company/servo-motor/*
Disallow /palembang/showcase/03
Disallow /showcase/karyatenda2
Disallow /showcase/karyatenda2
Disallow /sendemail.aspx*
Disallow /showcase/barangpecahbelah
Disallow /showcase/wahyufurniture1
Disallow /showcase/bungaalisa1
Disallow /showcase/cilokgoangtehlia1
Disallow /showcase/umer-inc.-di--rockford-illiois--peralatan-kantor-mendirikan-kantor-cabang-penjualan-di-palm-beach-florida.*
Disallow /showcase/distributor-lampu-led%2C-medan
Disallow /showcase/distributor-lampu-led%2C-medan
Disallow /showcase/price-compressor-ac-6-pk%2C-merk-copeland-scroll
Disallow /showcase/distributor-astor%2C-kacang-goreng%2C-sirup-marjan--bekasi
Disallow /showcase/the-acr120-contactless-smart-card-reader%2C-harga
Disallow /showcase/umer-inc.-di--rockford%2C-illiois%2C-distributor-peralatan-kantor-mendirikan-kantor-cabang-penjualan-di-palm-beach%2C-florida.
Disallow /showcase/-mesin-absensi-kartu-rfid-innovation-r208
Disallow /showcase/-mesin-absensi-kartu-rfid-innovation-r208
Disallow /showcase/-paket-cctv-freedom-16-ch-vision-pro
Disallow /showcase/-mesin-absensi-sidik-jari-innovation-f308c
Disallow /showcase/-mesin-absensi-sidik-jari-fingerprint-innovation-f308w
Disallow /showcase/-mesin-absensi-wajah-dan-sidik-jari-innovation-ff308
Disallow /newrfqv2.aspx*
Disallow /popupcc.aspx*
Disallow /*?s=*
Disallow /*?rfq=true
Disallow /*?readystock=true
Disallow /buyer.indotrading.com*
Disallow /webapipws.indotrading.com*
Disallow /test.indotrading.com*
Disallow /local.indotrading.com*
Back to top

Other Records

Field Value
sitemap https://www.indotrading.com/sitemap/sitemapindex.xml
Back to top

Comments

  • Disallowing Other Bots
Back to top

Warnings

  • 2 invalid lines.
Back to top