checkmydream.com
robots.txt
Robots Exclusion Standard data for checkmydream.com
Resource Scan
Scan Details
| Site Domain | checkmydream.com |
| Base Domain | checkmydream.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T10:31:11+00:00 |
| Next Scan | 2024-11-16T10:31:11+00:00 |
Last Scan
| Scanned | 2024-11-09T10:31:11+00:00 |
| URL | https://checkmydream.com/robots.txt |
| Domain IPs | 172.66.40.67, 172.66.43.189, 2606:4700:3108::ac42:2843, 2606:4700:3108::ac42:2bbd |
| Response IP | 172.66.43.189 |
| Found | Yes |
| Hash | b8a935265cf43e270dd351c5dc8277c8828ab95b1ad5adad6026ec803b3f5787 |
| SimHash | 7141ac74c3b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /anekdot |
| Disallow | /Anekdot |
| Disallow | /anekdot/ |
| Disallow | /Anekdot/ |
| Disallow | /dostoprimechatelnosti/ |
| Disallow | /dostoprimechatelnosti |
| Disallow | /Dostoprimechatelnosti |
| Disallow | /Dostoprimechatelnosti/ |
| Disallow | /admin/ |
| Disallow | *?p= |
| Disallow | *?m= |
| Disallow | *?paged= |
| Disallow | *?cat= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://checkmydream.com/sitemap.xml |
Warnings
- `host` is not a known field.