13or-du-hiphop.fr
robots.txt

Robots Exclusion Standard data for 13or-du-hiphop.fr

Resource Scan

Scan Details

Site Domain 13or-du-hiphop.fr
Base Domain 13or-du-hiphop.fr
Scan Status Ok
Last Scan2024-11-09T02:43:09+00:00
Next Scan 2024-11-16T02:43:09+00:00

Last Scan

Scanned2024-11-09T02:43:09+00:00
URL https://13or-du-hiphop.fr/robots.txt
Domain IPs 146.88.233.51
Response IP 146.88.233.51
Found Yes
Hash 78ea4e997cbbdf6e27bf04334e67c4d4e95fd3a3ac4967321e2123fde51dfad2
SimHash e15ed2654091

Groups

*

Rule Path
Disallow /fonction/
Disallow /v2/
Disallow /wanewsletter-2.2.13/
Disallow /parole/soprano-hiro-7260.html%5C
Disallow /cd/clip/parole/soprano-hiro-7260.html
Disallow /clip/parole/parole/soprano-hiro-7260.html
Disallow /clip/cd/parole/parole/soprano-hiro-7260.html
Disallow /son/cd/cd/parole/soprano-hiro-7260.html
Disallow /blog-rap-us/
Disallow /cd/corneille-entre-nord-et-sud-1769.html
Disallow /rap-francais-forum/
Disallow /clips/config/
Disallow /parole-rap//
Disallow /mp3-rap-francais//
Disallow /sons-mp3-us//
Disallow /albums-cd-us//
Disallow /le-blog-v2/
Disallow /wp-login.php
Disallow /2018/08/29/offset-caresse-les-parties-intimes-de-cardi-b-elle-filme-tout-video/
Disallow /?s=%EC%98%81%EC%B2%9C%EC%98%A4%ED%94%BC%EA%B1%B8%EF%BC%88%2B%EC%B9%B4%ED%86%A1%3AWB32%2B%EF%BC%89%EC%98%81%EC%B2%9C%2Bop%EC%BD%9C%EA%B1%B8%E2%9C%94%EC%98%81%EC%B2%9C%EC%B6%9C%EC%9E%A5%EB%A7%8C%EB%82%A8%E2%86%96%EC%98%81%EC%B2%9C%EC%95%A0%EC%9D%B8%EB%8C%80%ED%96%89
Disallow /rap_francais/news/amp/
Disallow /rappeurs/black-m/amp/
Disallow /rap_francais/son/amp/
Disallow /rappeurs/sadek/amp/
Disallow /rappeurs/kaaris/amp/
Disallow /divers/humour/amp/
Disallow /featured/amp/
Disallow /rappeurs/lartiste/amp/
Disallow /rap-us/clips-us/amp/
Disallow /rap-us/news-rap-us/amp/
Disallow /rap-us/clips-us/amp/
Disallow /rappeurs/georgio/amp/
Disallow /2020/10/01/niro-soupconne-de-fraude-fiscale-par-le-fisc-le-rappeur-risque-gros/amp/
Disallow /2020/11/22/damso-encore-insulte-severement-par-booba-sur-instagram/amp/
Disallow /2024/03/14/cardi-b-se-met-a-nu-pour-le-visuel-tres-ose-de-son-nouveau-single/
Disallow /2024/04/07/voici-pourquoi-baki-ne-parle-pas-dune-revanche-avec-cedric-doumbe/
Disallow /image_site/
Disallow /wp-admin
Disallow /wp-content
Disallow /wp-includes
Allow /wp-content/uploads/
Disallow /cgi-bin

wikiofeedbot 1.0

Rule Path
Disallow /

*

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Allow /*

googlebot-news

Rule Path
Disallow
Allow /*

Other Records

Field Value
sitemap https://www.13or-du-hiphop.fr/sitemap.xml

Comments

  • ne pas indexer la page de connexion du back-office
  • ne pas indexer le dossier wp-admin et ce qu’il contient
  • ne pas indexer le dossier wp-content et ce qu’il contient
  • ne pas indexer le dossier wp-includes et ce qu’il contient
  • On autorise l’indexation du dossier uploads contenant les photos et les vidéos...
  • Il s’agit d’une exception,
  • car ce dossier uploads est situé dans le dossier wp-content que l’on n’indexe pas.
  • on n’indexe pas ce répertoire sensible
  • User-agent: Googlebot-Image
  • Disallow: /wp-content/uploads/
  • Autoriser Google Image
  • Autoriser Google News