Log In Sign Up

bitcheats.net
robots.txt

Robots Exclusion Standard data for bitcheats.net

Resource Scan

Scan Details

Site Domain bitcheats.net
Base Domain bitcheats.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-13T00:15:39+00:00
Next Scan 2024-11-12T00:15:39+00:00

Last Successful Scan

Scanned2024-06-23T00:13:54+00:00
URL https://bitcheats.net/robots.txt
Domain IPs 104.21.60.172, 172.67.198.113, 2606:4700:3032::ac43:c671, 2606:4700:3036::6815:3cac
Response IP 104.21.60.172
Found Yes
Hash 01976f2816889a03a0ea52a51d9fd63fc208c126ef75e559fd6017e5519c9044
SimHash 52603760a4e2

Groups

accelatech rsscrawler

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blogshot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

buck

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

cloudservermarketspider

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

crawler

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

df

Rule Path
Disallow /

df bot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

fr-crawler

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gosign-security-crawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

hatena

Rule Path
Disallow /

hatena antenna

Rule Path
Disallow /

i-market-bot

Rule Path
Disallow /

iccrawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

implisensebot

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

inetdex-bot

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

just-crawler

Rule Path
Disallow /

kraken

Rule Path
Disallow /

kyoto-crawler

Rule Path
Disallow /

linguee

Rule Path
Disallow /

linkstats

Rule Path
Disallow /

lipperhey-kaus-australis

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

lwp

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mindupbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

naver

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

naverbot-1.0

Rule Path
Disallow /

netestate

Rule Path
Disallow /

nhnbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

outfoxbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

plista

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

pockey-gethtml

Rule Path
Disallow /

psbot

Rule Path
Disallow /

python/3.5 aiohttp

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

rewriterule

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rss_reader

Rule Path
Disallow /

phxbot

Rule Path
Disallow /

sabsimbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

sakebot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

serendeputybot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sg-orbiter

Rule Path
Disallow /

sidetrade

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

siteliner

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

t3versionsbot

Rule Path
Disallow /

thumbsniper

Rule Path
Disallow /

toweya.com

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

veoh

Rule Path
Disallow /

voyager

Rule Path
Disallow /

w3c-webcon

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

webalta

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webox

Rule Path
Disallow /

website explorer

Rule Path
Disallow /

wget

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

ws-bot-v1

Rule Path
Disallow /

xing

Rule Path
Disallow /

xing bot

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandex

Rule Path
Disallow /

zyborg

Rule Path
Disallow /
Back to top

Comments

  • For SEO & Site health & protecting the content
  • 34.42.98.183
  • 135.181.136.229
Back to top

Warnings

  • 6 invalid lines.
Back to top