ysts.cc
robots.txt

Robots Exclusion Standard data for ysts.cc

Resource Scan

Scan Details

Site Domain ysts.cc
Base Domain ysts.cc
Scan Status Ok
Last Scan2024-10-09T22:14:09+00:00
Next Scan 2024-10-16T22:14:09+00:00

Last Scan

Scanned2024-10-09T22:14:09+00:00
URL https://ysts.cc/robots.txt
Redirect https://www.ysts.cc/robots.txt
Redirect Domain www.ysts.cc
Redirect Base ysts.cc
Domain IPs 104.21.28.35, 172.67.144.12, 2606:4700:3033::6815:1c23, 2606:4700:3036::ac43:900c
Redirect IPs 104.21.28.35, 172.67.144.12, 2606:4700:3033::6815:1c23, 2606:4700:3036::ac43:900c
Response IP 172.67.144.12
Found Yes
Hash c42dc58675e79e9f0d437cfce3f68d8a485e8207243b0dec417e9e8fd4b59ec7
SimHash 1b348d4b3128

Groups

*

Rule Path
Disallow /application*
Disallow /cache*
Disallow /data*
Disallow /ptcms*

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrush

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

python

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

java

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

webdup

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

purebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wangidspider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

xbfmozilla

Rule Path
Disallow /

yottaa

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

swebot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

turnitinbot-agent

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

perl

Rule Path
Disallow /

python

Rule Path
Disallow /

wget

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /