silmid.com
robots.txt
Robots Exclusion Standard data for silmid.com
Resource Scan
Scan Details
| Site Domain | silmid.com |
| Base Domain | silmid.com |
| Scan Status | Ok |
| Last Scan | 2025-02-18T08:32:58+00:00 |
| Next Scan | 2025-03-20T08:32:58+00:00 |
Last Scan
| Scanned | 2025-02-18T08:32:58+00:00 |
| URL | https://silmid.com/robots.txt |
| Redirect | https://www.silmid.com/robots.txt |
| Redirect Domain | www.silmid.com |
| Redirect Base | silmid.com |
| Domain IPs | 93.184.249.212 |
| Redirect IPs | 93.184.249.212 |
| Response IP | 93.184.249.212 |
| Found | Yes |
| Hash | 1076f25f56286c0aa5f2926aa20d77b3ca9674b9f43a719bae1228016e74bc27 |
| SimHash | 440c9cb04ca3 |
Groups
ravencrawler
baiduspider
ltx71
companybook crawler
wget
wget/1.5.3
wget/1.6
sogou web spider/4.0
wotbox/2.01
trackifbot/0.1
pingdom.com_bot_version_1.4
aboundexbot
bubing
domaincrawler 1.0
domaincrawler 3.0
domaincrawler
contacts crawler
ahrefsbot
ahrefs-bot
ahrefsbot/1.0
ahrefs-bot/1.0
ahrefs-bot/2.0
ahrefs-bot/3.0
ahrefs-bot/4.0
ahrefs-bot/5.0
eccp/1.2.1
siteanalyzerbot/2.5
gptbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*Basket.aspx |
| Disallow | /*Checkout.aspx |
| Disallow | /*Login.aspx |
| Disallow | /*checkout |
| Disallow | /*login |
| Disallow | /basket/ |
| Disallow | /*?*filter=* |
| Disallow | /*?*sortorder=* |
| Disallow | /dsweb/* |
| Disallow | /*?*searchterm=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.silmid.com/sitemap_index.xml |