korii.slate.fr
robots.txt
Robots Exclusion Standard data for korii.slate.fr
Resource Scan
Scan Details
Site Domain | korii.slate.fr |
Base Domain | slate.fr |
Scan Status | Ok |
Last Scan | 2024-06-03T10:15:42+00:00 |
Next Scan | 2024-07-03T10:15:42+00:00 |
Last Scan
Scanned | 2024-06-03T10:15:42+00:00 |
URL | https://korii.slate.fr/robots.txt |
Domain IPs | 104.22.46.201, 104.22.47.201, 172.67.9.244, 2606:4700:10::6816:2ec9, 2606:4700:10::6816:2fc9, 2606:4700:10::ac43:9f4 |
Response IP | 104.22.47.201 |
Found | Yes |
Hash | 035797034cc36533849630bf774ee9179c9e1fef0e0c8c54135043f06cf05655 |
SimHash | dc140c326627 |
Groups
*
Rule | Path |
---|---|
Disallow | /assets/ |
Disallow | /board/ |
Disallow | /channels/ |
Disallow | /components/ |
Disallow | /controllers/ |
Disallow | /formatters/ |
Disallow | /helpers/ |
Disallow | /javascript/ |
Disallow | /jobs/ |
Disallow | /mailers/ |
Disallow | /models/ |
Disallow | /policies/ |
Disallow | /services/ |
Disallow | /uploads/ |
Disallow | /uploaders/ |
Disallow | /views/ |
Disallow | /workers/ |
Allow | /assets/*.css$ |
Allow | /assets/*.css? |
Allow | /assets/*.js$ |
Allow | /assets/*.js? |
Allow | /assets/*.gif |
Allow | /assets/*.jpg |
Allow | /assets/*.jpeg |
Allow | /assets/*.png |
Allow | /assets/*.woff$ |
Allow | /assets/*.woff2$ |
Allow | /assets/*.ttf$ |
Allow | /assets/*.eot$ |
Allow | /assets/*.svg$ |
Allow | /uploads/store/ |
Disallow | /api/ |
Disallow | /audio/board/ |
Disallow | /blognews/ |
Disallow | /BLOGS_CHRONIQUES/ |
Disallow | /cdn-cgi/ |
Disallow | /embed/ |
Disallow | /plus/ |
Disallow | /reader/ |
Disallow | /slate_amazon/ |
Disallow | /slate_podcasts/ |
Disallow | /slate_theme_serie/ |
Disallow | /slate_views_topics/ |
Disallow | /widgets/ |
Disallow | /21685585667/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://korii.slate.fr/sitemap.xml |
sitemap | https://korii.slate.fr/googlenews.xml |
Warnings
- `host` is not a known field.
Comments