kr.fashionnetwork.com
robots.txt

Robots Exclusion Standard data for kr.fashionnetwork.com

Resource Scan

Scan Details

Site Domain kr.fashionnetwork.com
Base Domain fashionnetwork.com
Scan Status Ok
Last Scan2024-05-25T16:46:45+00:00
Next Scan 2024-06-24T16:46:45+00:00

Last Scan

Scanned2024-05-25T16:46:45+00:00
URL https://kr.fashionnetwork.com/robots.txt
Domain IPs 104.18.2.7, 104.18.3.7, 2606:4700::6812:207, 2606:4700::6812:307
Response IP 104.18.3.7
Found Yes
Hash 0d8c3ce589e991cd1aac108aaa2e2a6c9df9e063fc59f77644d2c8c7ddd6705f
SimHash 9798893fd003

Groups

yandex

Rule Path
Allow /fluxNews/yandex*

steeler

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /*affiche_imprime_annonce.php*
Disallow /*popup%3D*/
Disallow /*redirect.php*
Disallow /*send_friend_news.php*
Disallow /*version_pdf.php*
Disallow /annuaire/
Disallow /account/
Disallow /agenda/*
Disallow /ajax/
Disallow /contact/
Disallow /clickheat/click.php
Disallow /dashboard/
Disallow /documentation/
Disallow /download/
Disallow /fashion_build/js/l-js-optimized*
Disallow /fashion_build/js/l-js-optimized*
Disallow /flux/
Disallow /fluxNews/
Disallow /include/
Disallow /keysearch.jsp*
Disallow /login/*
Disallow /membres/removefromnewsletter/*
Disallow /mobile.php*
Disallow /network/
Disallow /news/inscr_friend.php
Disallow /news/downloadPdf/*
Disallow /newsletters/*
Disallow /nl.php*
Disallow /nl/*
Disallow /parrainer/
Disallow /popup/
Disallow /redirect.php*
Disallow /redirect_news_international.php*
Disallow /register/
Disallow /rss/feed/
Disallow /search/
Disallow /societes/
Disallow /texte/*
Disallow /traduction/
Disallow /transaction/
Disallow /news/articles.php*
Disallow /news/print.php*
Disallow /news/news.php*
Disallow /news/news_list.php*
Disallow /news/rss.php
Disallow /news/statistiques.php
Disallow /news/search.php*
Disallow /news/video_list.php*
Disallow /news/video_view.php*
Disallow /photos/catwalks.php
Disallow /photos/photo.php*
Disallow /photos/photo_list.php*
Disallow /photos/photo_arbo.php*
Disallow /tendance/tendance.php*
Disallow /tendance/tendance_list.php*
Disallow /contact/validForm/
Disallow /fragments/*

yandexbot

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

Comments

  • To be purged into Google's cache
  • Ajax URIs
  • Fragments
  • Yandex : bloquer toutes les URL de news