cnet.de
robots.txt
Robots Exclusion Standard data for cnet.de
Resource Scan
Scan Details
| Site Domain | cnet.de |
| Base Domain | cnet.de |
| Scan Status | Ok |
| Last Scan | 2024-11-17T18:19:58+00:00 |
| Next Scan | 2024-11-24T18:19:58+00:00 |
Last Scan
| Scanned | 2024-11-17T18:19:58+00:00 |
| URL | http://cnet.de/robots.txt |
| Redirect | https://www.zdnet.de/robots.txt |
| Redirect Domain | www.zdnet.de |
| Redirect Base | zdnet.de |
| Domain IPs | 158.58.181.221 |
| Redirect IPs | 158.58.181.221 |
| Response IP | 158.58.181.221 |
| Found | Yes |
| Hash | 474f0899fe0a75d8b91d6b83be33a7eeedc8dddc7f61abb81e0e057215cf44b5 |
| SimHash | 3920d0022737 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /?s= |
| Disallow | /*comments/ |
| Disallow | /?pid= |
| Disallow | /?print= |
| Disallow | /?PageSpeed= |
| Disallow | /?utm= |
| Disallow | /author/ |
*
| Rule | Path |
|---|---|
| Disallow | /wp/wp-admin/ |
| Allow | /wp/wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.zdnet.de/sitemapindex.xml |
Comments