thuvienso.net
robots.txt
Robots Exclusion Standard data for thuvienso.net
Resource Scan
Scan Details
| Site Domain | thuvienso.net |
| Base Domain | thuvienso.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2025-10-28T08:02:28+00:00 |
| Next Scan | 2026-01-26T08:02:28+00:00 |
Last Successful Scan
| Scanned | 2025-03-31T15:45:38+00:00 |
| URL | https://thuvienso.net/robots.txt |
| Domain IPs | 113.177.128.77 |
| Response IP | 113.177.128.77 |
| Found | Yes |
| Hash | 254263d664f41ef1f191ef485ca577828f19263b9d6766e88e27b82fae2c7846 |
| SimHash | 501c894a8880 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
ahrefsbot
mj12bot
semrushbot
dotbot
sogou
petalbot
yandexbot
dataforseobot
amazonbot
anthropic-ai
applebot-extends
bytespider
ccbot
claudebot
claude-web
cohere-ai
diffbot
facebookbot
friendlycrawler
google-extended
image2dataset
imagesiftbot
meta-externalagent
omgilibot
perplexitybot
timpibot
barkrowler
blexbot
censysinspect
expanse
internet-measurement
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thuvienso.net/sitemaps/document/sitemap_index.xml |
Comments