chervepedia.com
robots.txt
Robots Exclusion Standard data for chervepedia.com
Resource Scan
Scan Details
| Site Domain | chervepedia.com |
| Base Domain | chervepedia.com |
| Scan Status | Ok |
| Last Scan | 2025-03-25T04:07:53+00:00 |
| Next Scan | 2025-04-24T04:07:53+00:00 |
Last Scan
| Scanned | 2025-03-25T04:07:53+00:00 |
| URL | https://chervepedia.com/robots.txt |
| Domain IPs | 104.21.42.101, 172.67.204.246, 2606:4700:3030::6815:2a65, 2606:4700:3035::ac43:ccf6 |
| Response IP | 104.21.42.101 |
| Found | Yes |
| Hash | a663a9e73d8cc5b27b2bb1db414964ee9eb18fb6f069499f855abf5de7cf6511 |
| SimHash | e80409048d91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /w/ |
| Disallow | /wiki/Special%3ASearch |
| Disallow | /wiki/Special%3ARandom |
| Disallow | /wiki/%D0%A1%D0%BB%D1%83%D0%B6%D0%B5%D0%B1%D0%BD%D0%B0%D1%8F%3A%D0%A1%D0%BB%D1%83%D1%87%D0%B0%D0%B9%D0%BD%D0%B0%D1%8F_%D1%81%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B0 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://chervepedia.com/w/sitemap.php |