unicode-table.com
robots.txt
Robots Exclusion Standard data for unicode-table.com
Resource Scan
Scan Details
| Site Domain | unicode-table.com |
| Base Domain | unicode-table.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T05:03:25+00:00 |
| Next Scan | 2024-11-17T05:03:25+00:00 |
Last Scan
| Scanned | 2024-11-10T05:03:25+00:00 |
| URL | https://unicode-table.com/robots.txt |
| Response IP | 94.26.229.171 |
| Found | Yes |
| Hash | 6b23757793f96f95a11d4623ca9e72bc3c7afe2fbae3c63416b8253969dff858 |
| SimHash | 28f0900ae173 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*/types/ |
| Disallow | /*/versions/ |
| Disallow | /*/about/ |
| Disallow | /*/search/ |
| Disallow | /*?* |
| Disallow | /*/planes/ |
| Disallow | /*/countries/ |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*/countries/ |
| Disallow | /*/planes/ |
| Disallow | /*/types/ |
| Disallow | /*/versions/ |
| Disallow | /*/about/ |
| Disallow | /*/search/ |
| Disallow | /*?*path* |
| Disallow | /*?*ivk_sa* |
| Disallow | /*?*hl* |
| Disallow | /*?*ref* |
| Disallow | /*?*nomobile* |
| Disallow | /*?*msclkid* |
| Disallow | /*?*_ym_debug* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://symbl.cc/sitemap.xml |
| sitemap | https://symbl.cc/sitemap_01.xml |
| sitemap | https://symbl.cc/sitemap_02.xml |
| sitemap | https://symbl.cc/sitemap_03.xml |
| sitemap | https://symbl.cc/sitemap_04.xml |
| sitemap | https://symbl.cc/sitemap_05.xml |
| sitemap | https://symbl.cc/sitemap_06.xml |
| sitemap | https://symbl.cc/sitemap_07.xml |
| sitemap | https://symbl.cc/sitemap_08.xml |
| sitemap | https://symbl.cc/sitemap_09.xml |
| sitemap | https://symbl.cc/sitemap_10.xml |
| sitemap | https://symbl.cc/sitemap_11.xml |
| sitemap | https://symbl.cc/sitemap_12.xml |
| sitemap | https://symbl.cc/sitemap_13.xml |
| sitemap | https://symbl.cc/sitemap_14.xml |
| sitemap | https://symbl.cc/sitemap_15.xml |
| sitemap | https://symbl.cc/sitemap_16.xml |
| sitemap | https://symbl.cc/sitemap_17.xml |
| sitemap | https://symbl.cc/sitemap_18.xml |
| sitemap | https://symbl.cc/sitemap_19.xml |
Warnings
- `clean-param` is not a known field.