hostscore.net
robots.txt
Robots Exclusion Standard data for hostscore.net
Resource Scan
Scan Details
| Site Domain | hostscore.net |
| Base Domain | hostscore.net |
| Scan Status | Ok |
| Last Scan | 2025-12-05T15:20:52+00:00 |
| Next Scan | 2025-12-12T15:20:52+00:00 |
Last Scan
| Scanned | 2025-12-05T15:20:52+00:00 |
| URL | https://hostscore.net/robots.txt |
| Domain IPs | 104.26.6.231, 104.26.7.231, 172.67.72.61, 2606:4700:20::681a:6e7, 2606:4700:20::681a:7e7, 2606:4700:20::ac43:483d |
| Response IP | 172.67.72.61 |
| Found | Yes |
| Hash | 3432015a4048d2a1fc9444176b76abd8687836eda4fb1801bdd9448f4752daa3 |
| SimHash | 713b7991e600 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /scores/ | - |
| Disallow | /cgi-bin/ | - |
| Disallow | /wp-admin/ | - |
| Disallow | *?s= | search |
| Disallow | *?search= | search |
| Disallow | *%26s%3D | search |
| Disallow | /search | search |
| Disallow | *?attachment_id= | attachment pages |
| Disallow | */trackback | - |
| Disallow | */embed | embed |
| Disallow | /wp-login.php | - |
| Disallow | /wp-register.php | - |
| Disallow | /wp-admin | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /downloads/ | - |
| Disallow | /backup/ | - |
| Disallow | /go/ | - |
| Disallow | /*/go/ | - |
| Disallow | /?blackhole | - |
| Disallow | */?query | - |
| Disallow | */?cst | - |
| Disallow | */?ref | - |
| Disallow | /cdn-cgi/ | - |
ccbot
diffbot
applebot-extended
webzio-extended
timpibot
pangubot
omgili
meta-externalagent
kangaroo bot
facebookbot
cohere-training-data-crawler
bytespider
dataprovider.com
dcrawl
httrack
httrack 3.0
metainspector
offline explorer
nutch
openindexspider
scrapy
barkrowler
blexbot
brightedge crawler
cocolyzebot
dataforseobot
dotbot
hypestat
mj12bot
linkdexbot
online-webceo-bot
semrushbot-ba
semrushbot-ct
semrushbot-si
semrushbot-swa
semrushbot
senutobot
seobilitybot
seokicks
serpstatbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hostscore.net/sitemap_index.xml |
| sitemap | https://hostscore.net/es/sitemap_index.xml |
| sitemap | https://hostscore.net/fr/sitemap_index.xml |
| sitemap | https://hostscore.net/de/sitemap_index.xml |
| sitemap | https://hostscore.net/it/sitemap_index.xml |
| sitemap | https://hostscore.net/pl/sitemap_index.xml |
| sitemap | https://hostscore.net/zh-CN/sitemap_index.xml |
| sitemap | https://hostscore.net/zh-TW/sitemap_index.xml |
| sitemap | https://hostscore.net/ms/sitemap_index.xml |
| sitemap | https://hostscore.net/id/sitemap_index.xml |
| sitemap | https://hostscore.net/ru/sitemap_index.xml |
| sitemap | https://hostscore.net/pt/sitemap_index.xml |
| sitemap | https://hostscore.net/ar/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments