mc-list.xyz
robots.txt
Robots Exclusion Standard data for mc-list.xyz
Resource Scan
Scan Details
| Site Domain | mc-list.xyz |
| Base Domain | mc-list.xyz |
| Scan Status | Ok |
| Last Scan | 2025-11-28T21:39:14+00:00 |
| Next Scan | 2025-12-05T21:39:14+00:00 |
Last Scan
| Scanned | 2025-11-28T21:39:14+00:00 |
| URL | https://mc-list.xyz/robots.txt |
| Domain IPs | 104.21.45.22, 172.67.208.15, 2606:4700:3030::6815:2d16, 2606:4700:3032::ac43:d00f |
| Response IP | 104.21.45.22 |
| Found | Yes |
| Hash | 0c4c1c4149deff153a8e7be64ab4d7f26bb4f3963c5a7498f2546f86edcbb5f9 |
| SimHash | 2d165865d79a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /ref |
| Disallow | /ajax/ |
| Disallow | /api/ |
| Disallow | /banner/ |
| Disallow | /cron/ |
| Disallow | /icon/ |
| Disallow | /og/ |
| Disallow | /pages/ |
| Disallow | /preview/ |
| Disallow | /upload/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mc-list.xyz/sitemap.xml |