crnfrance.fr
robots.txt
Robots Exclusion Standard data for crnfrance.fr
Resource Scan
Scan Details
| Site Domain | crnfrance.fr |
| Base Domain | crnfrance.fr |
| Scan Status | Ok |
| Last Scan | 2024-06-28T13:47:15+00:00 |
| Next Scan | 2024-07-05T13:47:15+00:00 |
Last Scan
| Scanned | 2024-06-28T13:47:15+00:00 |
| URL | https://crnfrance.fr/robots.txt |
| Redirect | https://www.crnfrance.fr/robots.txt |
| Redirect Domain | www.crnfrance.fr |
| Redirect Base | crnfrance.fr |
| Domain IPs | 104.21.19.98, 172.67.185.188, 2606:4700:3033::ac43:b9bc, 2606:4700:3034::6815:1362 |
| Redirect IPs | 104.21.19.98, 172.67.185.188, 2606:4700:3033::ac43:b9bc, 2606:4700:3034::6815:1362 |
| Response IP | 104.21.19.98 |
| Found | Yes |
| Hash | 52a20df257ee933eb6a5402fa7ee99f2fe84f249fae110c2b759126256636892 |
| SimHash | c118ec210513 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */breakingnews.asp |
| Disallow | */channel-encyclopedia/ |
| Disallow | */channelcommunity/ |
| Disallow | */components/ |
| Disallow | */Components/ |
| Disallow | */contributions/ |
| Disallow | */emailthisarticle.htm |
| Disallow | */encyclopedia/ |
| Disallow | */int/ |
| Disallow | */nl/ |
| Disallow | */print/ |
| Disallow | */printablearticle.htm |
| Disallow | */printableArticle.jhtml |
| Disallow | */printerFriendly.jhtml |
| Disallow | */printmail/ |
| Disallow | */printpdf/ |
| Disallow | */reviews/client-devices/ |
| Disallow | */sections/ |
| Disallow | */Sections/ |
| Disallow | */sponsored/ |
| Disallow | */stock-quotes-financial-data/ |
| Disallow | */tabletablearticle.htm |
| Disallow | */tools/quotes/index.jhtml |
| Disallow | */var/ |
| Disallow | /*.asp |
| Disallow | /*.asp$ |
| Disallow | /*.jhtml |
| Disallow | /*.jhtml$ |
| Disallow | /channel-encyclopedia/ |
| Disallow | /encyclopedia/ |
| Disallow | /search-request.htm |
| Disallow | /slide-shows/channel-programs/240007608/the-top-female-executives-of-the-2012-fast-growth-100.htm |
| Disallow | */tag/ |
| Disallow | /query/related/related |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.crn.com/sitemap-index.xml |
Warnings
- `host` is not a known field.