do.de
robots.txt
Robots Exclusion Standard data for do.de
Resource Scan
Scan Details
| Site Domain | do.de |
| Base Domain | do.de |
| Scan Status | Ok |
| Last Scan | 2024-06-02T12:28:56+00:00 |
| Next Scan | 2024-06-16T12:28:56+00:00 |
Last Scan
| Scanned | 2024-06-02T12:28:56+00:00 |
| URL | https://do.de/robots.txt |
| Redirect | https://www.do.de/robots.txt |
| Redirect Domain | www.do.de |
| Redirect Base | do.de |
| Domain IPs | 2a00:1200:0:8::a47, 95.128.200.168 |
| Redirect IPs | 2a00:1200:0:8::a47, 95.128.200.168 |
| Response IP | 95.128.200.168 |
| Found | Yes |
| Hash | 9991be435e230e3ecd3c8bc854092b144fe269f76fbb79cb30c1cd78ca9d8c67 |
| SimHash | cb384e42e235 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /trackback/ |
| Disallow | /feed/ |
| Disallow | /comments/ |
| Disallow | /category/ |
| Disallow | */tag/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
| Disallow | /*? |
| Disallow | */domains/check/ |
| Disallow | /cs/webspace_for_domain/ |
| Disallow | /cs/ssl_for_domain/ |
| Disallow | /cs/domain_bundle/ |
| Disallow | /checkout/basket/ |
| Disallow | /checkout/login/ |
| Disallow | /checkout/register/ |
| Disallow | /sell/ |
| Disallow | /whitepaper-website-trends-2024-download/ |
| Disallow | /wp-content/uploads/2023/12/whitepapertrends2024.pdf |
| Allow | /wp-content/uploads/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.do.de/sitemap.xml |