korii.slate.fr
robots.txt

Robots Exclusion Standard data for korii.slate.fr

Resource Scan

Scan Details

Site Domain korii.slate.fr
Base Domain slate.fr
Scan Status Ok
Last Scan2024-06-03T10:15:42+00:00
Next Scan 2024-07-03T10:15:42+00:00

Last Scan

Scanned2024-06-03T10:15:42+00:00
URL https://korii.slate.fr/robots.txt
Domain IPs 104.22.46.201, 104.22.47.201, 172.67.9.244, 2606:4700:10::6816:2ec9, 2606:4700:10::6816:2fc9, 2606:4700:10::ac43:9f4
Response IP 104.22.47.201
Found Yes
Hash 035797034cc36533849630bf774ee9179c9e1fef0e0c8c54135043f06cf05655
SimHash dc140c326627

Groups

*

Rule Path
Disallow /assets/
Disallow /board/
Disallow /channels/
Disallow /components/
Disallow /controllers/
Disallow /formatters/
Disallow /helpers/
Disallow /javascript/
Disallow /jobs/
Disallow /mailers/
Disallow /models/
Disallow /policies/
Disallow /services/
Disallow /uploads/
Disallow /uploaders/
Disallow /views/
Disallow /workers/
Allow /assets/*.css$
Allow /assets/*.css?
Allow /assets/*.js$
Allow /assets/*.js?
Allow /assets/*.gif
Allow /assets/*.jpg
Allow /assets/*.jpeg
Allow /assets/*.png
Allow /assets/*.woff$
Allow /assets/*.woff2$
Allow /assets/*.ttf$
Allow /assets/*.eot$
Allow /assets/*.svg$
Allow /uploads/store/
Disallow /api/
Disallow /audio/board/
Disallow /blognews/
Disallow /BLOGS_CHRONIQUES/
Disallow /cdn-cgi/
Disallow /embed/
Disallow /plus/
Disallow /reader/
Disallow /slate_amazon/
Disallow /slate_podcasts/
Disallow /slate_theme_serie/
Disallow /slate_views_topics/
Disallow /widgets/
Disallow /21685585667/

Other Records

Field Value
crawl-delay 10

googlebot-news
dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 900

orangebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 900

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://korii.slate.fr/sitemap.xml
sitemap https://korii.slate.fr/googlenews.xml

Comments

  • Directories
  • CSS, JS, Images
  • V4

Warnings

  • `host` is not a known field.