Log In Sign Up

ysts5.com
robots.txt

Robots Exclusion Standard data for ysts5.com

Resource Scan

Scan Details

Site Domain ysts5.com
Base Domain ysts5.com
Scan Status Ok
Last Scan2024-10-08T16:11:40+00:00
Next Scan 2024-10-15T16:11:40+00:00

Last Scan

Scanned2024-10-08T16:11:40+00:00
URL https://ysts5.com/robots.txt
Redirect https://www.ysts5.com/robots.txt
Redirect Domain www.ysts5.com
Redirect Base ysts5.com
Domain IPs 104.21.47.160, 172.67.149.16, 2606:4700:3034::6815:2fa0, 2606:4700:3036::ac43:9510
Redirect IPs 104.21.47.160, 172.67.149.16, 2606:4700:3034::6815:2fa0, 2606:4700:3036::ac43:9510
Response IP 172.67.149.16
Found Yes
Hash c42dc58675e79e9f0d437cfce3f68d8a485e8207243b0dec417e9e8fd4b59ec7
SimHash 1b348d4b3128

Groups

*

Rule Path
Disallow /application*
Disallow /cache*
Disallow /data*
Disallow /ptcms*

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrush

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

python

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

java

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

webdup

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

purebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wangidspider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

xbfmozilla

Rule Path
Disallow /

yottaa

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

swebot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

turnitinbot-agent

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

perl

Rule Path
Disallow /

python

Rule Path
Disallow /

wget

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /
Back to top