cfnews.net
robots.txt

Robots Exclusion Standard data for cfnews.net

Resource Scan

Scan Details

Site Domain cfnews.net
Base Domain cfnews.net
Scan Status Ok
Last Scan2024-11-14T23:21:12+00:00
Next Scan 2024-11-28T23:21:12+00:00

Last Scan

Scanned2024-11-14T23:21:12+00:00
URL https://cfnews.net/robots.txt
Redirect https://www.cfnews.net/robots.txt
Redirect Domain www.cfnews.net
Redirect Base cfnews.net
Domain IPs 91.134.250.80
Redirect IPs 91.134.250.80
Response IP 91.134.250.80
Found Yes
Hash d458dd45129b071d0a159533b7b728d0c7fc487c250718f6325f31da6143c6a8
SimHash df1d5220c4d2

Groups

*

Rule Path
Disallow /Annuaires-base-de-deals/Vehicules?*
Disallow /Annuaires-base-de-deals/Mouvements?*
Disallow /Annuaires-base-de-deals/Operations?*
Disallow /Annuaires-base-de-deals/Societes?*
Disallow /Annuaires-base-de-deals/Acteurs-Corporate-Finance?*
Disallow /Referentiel/Acteurs-du-Corporate-Finance/%28acteur_domaine%29*
Disallow /Referentiel/Operations/%28op_domaine%29*
Disallow /Referentiel/Operations?*
Disallow /Referentiel/Societes?*
Disallow /Referentiel/Mouvements?*
Disallow /Referentiel/Vehicules?*
Disallow /search/global*
Disallow /content/advancedsearch*
Disallow /download/
Disallow /print/
Disallow /index/*
Disallow /Annuaires-base-de-deals/Bottin-des-Personnalites/*
Disallow /Annuaires-base-de-deals/Bottin-des-Personnalites
Disallow /cfn/*

googlebot-news
ahrefsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /Annuaires-base-de-deals/*
Disallow /Referentiel/Operations
Disallow /index/*
Disallow /Annuaires-base-de-deals/Bottin-des-Personnalites/*

netvibes

Rule Path
Disallow /

scooperbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

csnibot

Rule Path
Disallow /Annuaires-base-de-deals/*
Disallow /index/*

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cfnews.net/sitemaps/sitemap.xml
sitemap https://www.cfnews.net/sitemaps/sitemap-news.xml

Comments

  • CQ 26/09/2022