zdnet.fr
robots.txt
Robots Exclusion Standard data for zdnet.fr
Resource Scan
Scan Details
Site Domain | zdnet.fr |
Base Domain | zdnet.fr |
Scan Status | Ok |
Last Scan | 2025-09-18T00:58:50+00:00 |
Next Scan | 2025-09-25T00:58:50+00:00 |
Last Scan
Scanned | 2025-09-18T00:58:50+00:00 |
URL | https://zdnet.fr/robots.txt |
Redirect | https://www.zdnet.fr/robots.txt |
Redirect Domain | www.zdnet.fr |
Redirect Base | zdnet.fr |
Domain IPs | 104.26.10.240, 104.26.11.240, 172.67.75.39, 2606:4700:20::681a:af0, 2606:4700:20::681a:bf0, 2606:4700:20::ac43:4b27 |
Redirect IPs | 104.26.10.240, 104.26.11.240, 172.67.75.39, 2606:4700:20::681a:af0, 2606:4700:20::681a:bf0, 2606:4700:20::ac43:4b27 |
Response IP | 172.67.75.39 |
Found | Yes |
Hash | 0517e9a7ec4d18d854d222000e17adfd1f147dd2cd9f1fa35a41de5e3754e582 |
SimHash | 894adc82a03a |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wpcontent/cache |
Disallow | /trackback |
Disallow | /*.php$ |
Disallow | /*.inc$ |
Disallow | /*.gz$ |
Disallow | /wp-login.php |
Disallow | /*?s= |
Disallow | /readme.html |
Disallow | /serviceworker.js |
Disallow | /blogs/.../ |
Disallow | /marque/ |
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://www.zdnet.fr/sitemap-news.xml |
sitemap | https://www.zdnet.fr/sitemap_index.xml |
Comments