tsxcfw.com
robots.txt

Robots Exclusion Standard data for tsxcfw.com

Resource Scan

Scan Details

Site Domain tsxcfw.com
Base Domain tsxcfw.com
Scan Status Ok
Last Scan2025-12-11T03:34:52+00:00
Next Scan 2026-01-10T03:34:52+00:00

Last Scan

Scanned2025-12-11T03:34:52+00:00
URL http://www.tsxcfw.com/robots.txt
Domain IPs 27.221.126.143
Response IP 27.221.126.143
Found Yes
Hash b3fd9186b2b4b2befff47f00044bc75e83c2380fe660886d74a79c09d5a92a64
SimHash 405e44225222

Groups

blexbot

Rule Path
Disallow /

abonti

Rule Path
Disallow /

admantx

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

check_http

Rule Path
Disallow /

checks.panopta.com

Rule Path
Disallow /

dle_spider.exe

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

gbplugin

Rule Path
Disallow /

yandex

Rule Path
Disallow /

gooblog

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

holmesbot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

infoseek sidewinder

Rule Path
Disallow /

infoseek sidewinder/2.0b (linux 2.4 i686)

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

moget

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

opensiteexplorer

Rule Path
Disallow /

semrush

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

*

Rule Path
Disallow jiangou.asp
Disallow cbs_zys_books.asp
Disallow /pdfread/
Disallow /pdfshidu/
Disallow /jgdown/
Disallow /dzshidu/
Disallow /html/
Disallow /login/
Disallow /uploadfile/
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /*.gif$
Disallow /*.png$
Disallow /*.bmp$

Other Records

Field Value
crawl-delay 15