cnetfrance.fr
robots.txt
Robots Exclusion Standard data for cnetfrance.fr
Resource Scan
Scan Details
| Site Domain | cnetfrance.fr |
| Base Domain | cnetfrance.fr |
| Scan Status | Ok |
| Last Scan | 2024-11-12T22:31:23+00:00 |
| Next Scan | 2024-11-19T22:31:23+00:00 |
Last Scan
| Scanned | 2024-11-12T22:31:23+00:00 |
| URL | https://cnetfrance.fr/robots.txt |
| Redirect | https://www.cnetfrance.fr/robots.txt |
| Redirect Domain | www.cnetfrance.fr |
| Redirect Base | cnetfrance.fr |
| Domain IPs | 104.26.4.122, 104.26.5.122, 172.67.74.223, 2606:4700:20::681a:47a, 2606:4700:20::681a:57a, 2606:4700:20::ac43:4adf |
| Redirect IPs | 104.26.4.122, 104.26.5.122, 172.67.74.223, 2606:4700:20::681a:47a, 2606:4700:20::681a:57a, 2606:4700:20::ac43:4adf |
| Response IP | 172.67.74.223 |
| Found | Yes |
| Hash | 887309935a72263f924e124654f132d334f1d31a5e36521b662f0d31b7279751 |
| SimHash | 7942f9c4549c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /6975/FR/ |
| Disallow | /shopredirect.htm |
| Disallow | /?s= |
| Disallow | /?sort= |
| Disallow | /search |
| Disallow | /newreply |
| Disallow | /printthread |
| Disallow | /sendmessage |
| Disallow | /subscription |
| Disallow | /newthread.php |
| Disallow | /index.php |
| Disallow | /showthread |
| Disallow | /archive/ |
| Disallow | /user/ |
| Disallow | /api/prices.html |
| Disallow | /ajax/api/node/incrementNodeview |
| Disallow | /telecharger/ajax/ |
| Disallow | /telecharger/recherche/ |
| Disallow | /telecharger/*-telechargement.htm |
| Disallow | /telecharger/*-merci.htm |
| Disallow | /rechercher/ |
| Disallow | /amp/ |
| Disallow | /39 |
| Disallow | /auteur/*/page/ |
| Disallow | /telecharger/recherche? |
| Disallow | /telecharger/categorie/ |
| Disallow | /post-sitemap*.xml |
| Disallow | /wp-content/themes/cnet/assets/images/icons/svg/icon-buyers-guides--day.svg |
*
| Rule | Path |
|---|---|
| Disallow | /?s= |
| Disallow | /page/*/?s= |
| Disallow | /search/ |
| Disallow | /wp-json/ |
| Disallow | /?rest_route= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cnetfrance.fr/sitemap-news.xml |
| sitemap | https://www.cnetfrance.fr/sitemap_index.xml |
| sitemap | https://www.cnetfrance.fr/sitemap-news.xml |
| sitemap | https://www.cnetfrance.fr/sitemap-contenu-index.xml |
| sitemap | https://www.cnetfrance.fr/sitemap-images.xml |
| sitemap | https://www.cnetfrance.fr/telecharger/telechargements.xml.gz |
| sitemap | https://www.cnetfrance.fr/telecharger/telechargements-inactif.xml.gz |
| sitemap | https://www.cnetfrance.fr/sitemap_index.xml |
Comments