forum.beta.the-west.net
robots.txt

Robots Exclusion Standard data for forum.beta.the-west.net

Archived Snapshots

Resource Scan

Scan Details

Site Domain	forum.beta.the-west.net
Base Domain	the-west.net
Scan Status	Ok
Last Scan	2025-11-07T00:32:11+00:00
Next Scan	2025-12-07T00:32:11+00:00

Last Scan

Scanned	2025-11-07T00:32:11+00:00
URL	https://forum.beta.the-west.net/robots.txt
Domain IPs	212.53.146.26, 2a13:5a40:11f0:7001::d435:921a
Response IP	212.53.146.26
Found	Yes
Hash	e2f96455d5dbcf3f1c3769578ebbe90f6b7258bc40c0039084a025d0c1547e57
SimHash	73965631ce83

Groups

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

oai-searchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

swiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou

Rule	Path
Disallow	/

Rule

Path

Disallow

facebot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookbot

Rule	Path
Disallow	/

Rule

Path

Disallow

operator

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalfetcher

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalagent

Rule	Path
Disallow	/

Rule

Path

Disallow

pangubot

Rule	Path
Disallow	/

Rule

Path

Disallow

youbot

Rule	Path
Disallow	/

Rule

Path

Disallow

imagesiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seekportbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

zoominfobot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinksextendedbot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandeximages

Rule	Path
Disallow	/

Rule

Path

Disallow

mojeekbot

Rule	Path
Disallow	/

Rule

Path

Disallow

neticle crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot-web

Rule	Path
Disallow	/

Rule

Path

Disallow

trendictionbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

awariobot

Rule	Path
Disallow	/

Rule

Path

Disallow

zoombot

Rule	Path
Disallow	/

Rule

Path

Disallow

sentibot

Rule	Path
Disallow	/

Rule

Path

Disallow

uptimerobot

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks

Rule

Path

Disallow

timpibot

Rule

Path

Disallow

forum.beta.the-west.netrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

claudebot

bingbot

amazonbot

bytespider

yandexbot

gptbot

chatgpt-user

oai-searchbot

applebot

applebot-extended

baiduspider

barkrowler

perplexitybot

petalbot

dotbot

exabot

swiftbot

sogou

facebot

facebookbot

operator

meta-externalfetcher

meta-externalagent

pangubot

youbot

imagesiftbot

seekportbot

seznambot

zoominfobot

backlinksextendedbot

turnitinbot

ahrefsbot

semrushbot

sosospider

blexbot

mj12bot

mail.ru_bot

yandeximages

mojeekbot

neticle crawler

coccocbot-web

trendictionbot

dataforseobot

awariobot

zoombot

sentibot

uptimerobot

serpstatbot

seokicks

timpibot

forum.beta.the-west.net
robots.txt