rate.rs
robots.txt
Robots Exclusion Standard data for rate.rs
Resource Scan
Scan Details
| Site Domain | rate.rs |
| Base Domain | rate.rs |
| Scan Status | Ok |
| Last Scan | 2024-09-18T16:45:23+00:00 |
| Next Scan | 2024-09-25T16:45:23+00:00 |
Last Scan
| Scanned | 2024-09-18T16:45:23+00:00 |
| URL | https://rate.rs/robots.txt |
| Domain IPs | 2001:1b28:4::8:176, 212.7.8.176 |
| Response IP | 212.7.8.176 |
| Found | Yes |
| Hash | fd9b72d4d1da78e627eb3b995dd246c398fc98fd5606add4e6606821e570fd79 |
| SimHash | 3f040e234fb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /blocked |
| Disallow | /messages |
| Disallow | /checkphoto |
| Disallow | /*xref |
| Disallow | /index/online_users |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rate.rs/sitemap.xml |
| sitemap | https://rate.rs/sitemap.xml |
| sitemap | https://rate.rs/sitemap.xml |
| sitemap | https://m.rate.rs/sitemap.xml |
Warnings
- 1 invalid line.
- `host` is not a known field.