en.crystalls.info
robots.txt
Robots Exclusion Standard data for en.crystalls.info
Resource Scan
Scan Details
| Site Domain | en.crystalls.info |
| Base Domain | crystalls.info |
| Scan Status | Ok |
| Last Scan | 2025-10-10T21:05:55+00:00 |
| Next Scan | 2025-11-09T21:05:55+00:00 |
Last Scan
| Scanned | 2025-10-10T21:05:55+00:00 |
| URL | https://en.crystalls.info/robots.txt |
| Domain IPs | 45.130.41.112 |
| Response IP | 45.130.41.112 |
| Found | Yes |
| Hash | 1777dff75ba91d7af5a3aec8736e3d0709886383111ee6bfd4839d497599ce6b |
| SimHash | 08110f7d8ef5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /en/ |
| Disallow | /ru/ |
| Disallow | /w/uploads/media/**/*.json |
| Disallow | /w/uploads/media/thumb/webp/ |
| Allow | /w/uploads/ |
| Allow | /w/load.php? |
| Allow | /w/libs/ |
| Allow | /w/images/ |
| Allow | /w/resources/ |
| Allow | /w/sitemap_ru.xml |
| Allow | /w/sitemap_en.xml |
| Allow | /w/extensions/SemanticMediaWiki/res/ |
| Disallow | /w/ |
| Disallow | /home/ |
| Disallow | /smw/ |
| Disallow | /MediaWiki%3A* |
| Disallow | /Special%3A* |
| Disallow | /%D0%A1%D0%BB%D1%83%D0%B6%D0%B5%D0%B1%D0%BD%D0%B0%D1%8F%3A* |
| Disallow | /Template%3A* |
| Disallow | /%D0%A8%D0%B0%D0%B1%D0%BB%D0%BE%D0%BD%3A* |
| Disallow | /Property%3A* |
| Disallow | /%D0%A1%D0%B2%D0%BE%D0%B9%D1%81%D1%82%D0%B2%D0%BE%3A* |
| Disallow | /User%3A* |
| Disallow | /%D0%A3%D1%87%D0%B0%D1%81%D1%82%D0%BD%D0%B8%D0%BA%3A* |
| Disallow | /%D0%A3%D1%87%D0%B0%D1%81%D1%82%D0%BD%D0%B8%D1%86%D0%B0%3A* |
| Disallow | /Talk* |
| Disallow | /%D0%9E%D0%B1%D1%81%D1%83%D0%B6%D0%B4%D0%B5%D0%BD%D0%B8%D0%B5* |
| Disallow | /*? |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ru.crystalls.info/w/sitemap_ru.xml |
| sitemap | https://en.crystalls.info/w/sitemap_en.xml |