rarewert.de
robots.txt
Robots Exclusion Standard data for rarewert.de
Resource Scan
Scan Details
| Site Domain | rarewert.de |
| Base Domain | rarewert.de |
| Scan Status | Ok |
| Last Scan | 2026-02-23T15:24:04+00:00 |
| Next Scan | 2026-03-02T15:24:04+00:00 |
Last Scan
| Scanned | 2026-02-23T15:24:04+00:00 |
| URL | https://rarewert.de/robots.txt |
| Domain IPs | 202.61.233.219 |
| Response IP | 202.61.233.219 |
| Found | Yes |
| Hash | f5d0e6f622078ab7cab1f448c6f980729ef5d79c70eb7e2ffff6814ef5a63260 |
| SimHash | 4b3e8ce1e7fa |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administration/ |
| Disallow | /admincore/ |
| Disallow | /servercore/ |
| Disallow | /includes/ |
| Disallow | /ajax/ |
| Disallow | /api/ |
| Disallow | /cron/ |
| Disallow | /uploads/tmp/ |
| Disallow | /*?* |
| Disallow | /*%26* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rarewert.de/sitemap.php |
Comments