korii.slate.fr
robots.txt
Robots Exclusion Standard data for korii.slate.fr
Resource Scan
Scan Details
| Site Domain | korii.slate.fr |
| Base Domain | slate.fr |
| Scan Status | Ok |
| Last Scan | 2024-10-31T12:41:38+00:00 |
| Next Scan | 2024-11-30T12:41:38+00:00 |
Last Scan
| Scanned | 2024-10-31T12:41:38+00:00 |
| URL | https://korii.slate.fr/robots.txt |
| Domain IPs | 104.22.46.201, 104.22.47.201, 172.67.9.244, 2606:4700:10::6816:2ec9, 2606:4700:10::6816:2fc9, 2606:4700:10::ac43:9f4 |
| Response IP | 104.22.47.201 |
| Found | Yes |
| Hash | e5955e8cc1d1271f9f4873d35d54c157a96b6153ecfe7e665a8aac6b4e8318e4 |
| SimHash | f41710526605 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /assets/ |
| Disallow | /board/ |
| Disallow | /channels/ |
| Disallow | /components/ |
| Disallow | /controllers/ |
| Disallow | /formatters/ |
| Disallow | /helpers/ |
| Disallow | /javascript/ |
| Disallow | /jobs/ |
| Disallow | /mailers/ |
| Disallow | /models/ |
| Disallow | /policies/ |
| Disallow | /services/ |
| Disallow | /uploads/ |
| Disallow | /uploaders/ |
| Disallow | /views/ |
| Disallow | /workers/ |
| Allow | /assets/*.css$ |
| Allow | /assets/*.css? |
| Allow | /assets/*.js$ |
| Allow | /assets/*.js? |
| Allow | /assets/*.gif |
| Allow | /assets/*.jpg |
| Allow | /assets/*.jpeg |
| Allow | /assets/*.png |
| Allow | /assets/*.woff$ |
| Allow | /assets/*.woff2$ |
| Allow | /assets/*.ttf$ |
| Allow | /assets/*.eot$ |
| Allow | /assets/*.svg$ |
| Allow | /uploads/store/ |
| Disallow | /api/ |
| Disallow | /audio/board/ |
| Disallow | /blognews/ |
| Disallow | /BLOGS_CHRONIQUES/ |
| Disallow | /cdn-cgi/ |
| Disallow | /embed/ |
| Disallow | /plus/ |
| Disallow | /reader/ |
| Disallow | /slate_amazon/ |
| Disallow | /slate_podcasts/ |
| Disallow | /slate_theme_serie/ |
| Disallow | /slate_views_topics/ |
| Disallow | /widgets/ |
| Disallow | /21685585667/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://korii.slate.fr/sitemap.xml |
| sitemap | https://korii.slate.fr/googlenews.xml |
Warnings
- 4 invalid lines.
- `host` is not a known field.
Comments