bindt.org
robots.txt
Robots Exclusion Standard data for bindt.org
Resource Scan
Scan Details
| Site Domain | bindt.org |
| Base Domain | bindt.org |
| Scan Status | Ok |
| Last Scan | 2024-11-06T22:06:20+00:00 |
| Next Scan | 2024-12-06T22:06:20+00:00 |
Last Scan
| Scanned | 2024-11-06T22:06:20+00:00 |
| URL | https://www.bindt.org/robots.txt |
| Domain IPs | 93.184.255.10 |
| Response IP | 93.184.255.10 |
| Found | Yes |
| Hash | f1bb44b81a8429b7d1db430bc6105a483ed201fe817a814a2ed654d7682ffff7 |
| SimHash | c861fd006ea2 |
Groups
ahrefsbot
digext
dts agent
mj12bot
easouspider
megaindex.ru
crawler4j
curious george
curious george - www.analyticsseo.com
mj12
steeler
findxbot
seznambot
seznam
vagabondo
jakarta
lwp
smtbot
memorybot
smrjbot
spbot
semrushbot
dotbot
sogou spider
youdaobot
naverbot
yeti
moget
ichiro
baiduspider
baiduspider-image
baiduspider-news
baiduspider-favo
baiduspider-video
baiduspider-cpro
baiduspider-ads
blexbot
rogerbot
ltx71
yandex
python-requests
ltx71
siteexplorer
companybook-crawler
zumbot
barkrowler
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*Basket.aspx |
| Disallow | /*Checkout.aspx |
| Disallow | /*Login.aspx |
| Disallow | /*checkout |
| Disallow | /Basket.aspx |
| Disallow | /Checkout.aspx |
| Disallow | /Error.aspx |
| Disallow | /*login |
| Disallow | /*basket |
| Disallow | /*?*filter=* |
| Disallow | /*?*sortorder=* |
| Disallow | /my-account* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- 1 invalid line.