vstxset.xyz
robots.txt

Robots Exclusion Standard data for vstxset.xyz

Resource Scan

Scan Details

Site Domain vstxset.xyz
Base Domain vstxset.xyz
Scan Status Ok
Last Scan2025-08-20T22:16:48+00:00
Next Scan 2025-09-19T22:16:48+00:00

Last Scan

Scanned2025-08-20T22:16:48+00:00
URL https://www.vstxset.xyz/robots.txt
Redirect https://www.mvtftbn.com/robots.txt
Redirect Domain www.mvtftbn.com
Redirect Base mvtftbn.com
Domain IPs 156.255.123.79
Redirect IPs 2600:9000:28c2:1400:5:a910:f080:93a1, 2600:9000:28c2:1800:5:a910:f080:93a1, 2600:9000:28c2:5200:5:a910:f080:93a1, 2600:9000:28c2:8e00:5:a910:f080:93a1, 2600:9000:28c2:aa00:5:a910:f080:93a1, 2600:9000:28c2:d600:5:a910:f080:93a1, 2600:9000:28c2:e200:5:a910:f080:93a1, 2600:9000:28c2:ee00:5:a910:f080:93a1, 3.171.198.3, 3.171.198.39, 3.171.198.64, 3.171.198.71
Response IP 3.171.198.64
Found Yes
Hash 940d36b9d0cae656a253690b6683983e4815fc44763eb6c880d08bba1e67570d
SimHash 7405d01baff1

Groups

*

Rule Path
Disallow /admin*
Disallow /danmaku/*
Disallow /feed/*
Disallow /archives/*/comment-page-*
Disallow /comment-page-*?replyTo=*
Disallow /*.html/comment-page-*
Disallow /upload*/xiao/*
Disallow /*?replyTo=*
Disallow /*?ysclid=*
Disallow /*?continueFlag=*
Disallow /cmt/
Disallow */respond-post-*/
Disallow /*?continueFlag=
Allow /archives/
Allow /tag/
Allow /category/
Allow /author/

googlebot

Rule Path
Disallow /feed/

bingbot

Rule Path
Disallow /feed/

yandex

Rule Path
Allow /feed/
Allow /feed/rss/
Allow /feed/atom/

Other Records

Field Value
sitemap https://51cg1.com/sitemap.xml