emilfrey.de
robots.txt
Robots Exclusion Standard data for emilfrey.de
Resource Scan
Scan Details
| Site Domain | emilfrey.de |
| Base Domain | emilfrey.de |
| Scan Status | Ok |
| Last Scan | 2024-05-20T06:45:37+00:00 |
| Next Scan | 2024-06-19T06:45:37+00:00 |
Last Scan
| Scanned | 2024-05-20T06:45:37+00:00 |
| URL | https://www.emilfrey.de/robots.txt |
| Domain IPs | 13.33.30.124, 13.33.30.19, 13.33.30.71, 13.33.30.75, 2600:9000:229f:0:16:ea8f:740:93a1, 2600:9000:229f:5c00:16:ea8f:740:93a1, 2600:9000:229f:600:16:ea8f:740:93a1, 2600:9000:229f:6c00:16:ea8f:740:93a1, 2600:9000:229f:a600:16:ea8f:740:93a1, 2600:9000:229f:b000:16:ea8f:740:93a1, 2600:9000:229f:c00:16:ea8f:740:93a1, 2600:9000:229f:c800:16:ea8f:740:93a1 |
| Response IP | 13.33.30.75 |
| Found | Yes |
| Hash | 8c4738682844bb46a243047e524a3db905ccb1e59994df4fad72ffbd9aacf342 |
| SimHash | e011b6497ed3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?* |
| Disallow | /fileadmin/_temp_/ |
| Disallow | /typo3/ |
| Disallow | /auto-kaufen/min1 |
| Disallow | /auto-kaufen/min2 |
| Disallow | /auto-kaufen/min3 |
| Disallow | /auto-kaufen/min4 |
| Disallow | /auto-kaufen/min5 |
| Disallow | /auto-kaufen/min6 |
| Disallow | /auto-kaufen/min7 |
| Disallow | /auto-kaufen/min8 |
| Disallow | /auto-kaufen/min9 |
| Disallow | /REST/ |
| Allow | /*?sitemap=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.emilfrey.de/sitemap/index.xml |