rapoucreve.com
robots.txt

Robots Exclusion Standard data for rapoucreve.com

Resource Scan

Scan Details

Site Domain rapoucreve.com
Base Domain rapoucreve.com
Scan Status Ok
Last Scan2024-09-23T23:46:32+00:00
Next Scan 2024-09-30T23:46:32+00:00

Last Scan

Scanned2024-09-23T23:46:32+00:00
URL https://rapoucreve.com/robots.txt
Domain IPs 2a02:4780:b:1395:0:35a1:a08d:3, 89.116.192.207
Response IP 89.116.192.207
Found Yes
Hash 12439a5e283daff0ef00e2938f951f9315cf3f4b695e917912a2820844c56d6b
SimHash 6d30c586ce97

Groups

*

Rule Path
Disallow /files_perso/
Disallow /gestion/
Disallow /images/
Disallow /rap/
Allow /fr/actus-rap/
Allow /en/rap-news/
Allow /fr/compilations/
Allow /en/compilations/
Allow /fr/top-10/
Allow /en/top-10/
Allow /fr/boutique/
Allow /en/shop/
Allow /fr/envoyez-votre-video-single/
Allow /en/send-your-video-single/
Allow /fr/publicite/
Allow /en/advertising/
Allow /fr/nous-rejoindre/
Allow /en/join-us/

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

googlebot-video

Rule Path
Allow

googlebot-news

Rule Path
Allow

googlebot-image/1.0

Rule Path
Allow

googlebot-video/1.0

Rule Path
Allow

googlebot-mobile

Rule Path
Allow

msnbot

Rule Path
Allow

msnbot-media

Rule Path
Allow

slurp

Rule Path
Allow

teoma

Rule Path
Allow

gigabot

Rule Path
Allow

robozilla

Rule Path
Allow

nutch

Rule Path
Allow

ia_archiver

Rule Path
Allow

baiduspider

Rule Path
Allow

baiduspider-image

Rule Path
Allow

baiduspider-news

Rule Path
Allow

baiduspider-video

Rule Path
Allow

yandexbot

Rule Path
Allow

yandexmobilebot

Rule Path
Allow

yandexmedia

Rule Path
Allow

yandeximages

Rule Path
Allow

yandexnews

Rule Path
Allow

duckduckbot

Rule Path
Allow

aolbuild

Rule Path
Allow

teoma

Rule Path
Allow

naverbot

Rule Path
Allow

yeti

Rule Path
Allow

yahoo-mmcrawler

Rule Path
Allow

psbot

Rule Path
Allow

yahoo-blogs/v3.9

Rule Path
Allow

twitterbot

Rule Path
Allow

Other Records

Field Value
sitemap https://www.rapoucreve.com/sitemaps.xml

Comments

  • RAP OU CRĒVE - RapOuCreve.com [16-07-2019]