cfpsecurite.com
robots.txt

Robots Exclusion Standard data for cfpsecurite.com

Resource Scan

Scan Details

Site Domain cfpsecurite.com
Base Domain cfpsecurite.com
Scan Status Ok
Last Scan2024-09-20T21:27:37+00:00
Next Scan 2024-10-20T21:27:37+00:00

Last Scan

Scanned2024-09-20T21:27:37+00:00
URL https://cfpsecurite.com/robots.txt
Redirect https://www.cfpsecurite.com/robots.txt
Redirect Domain www.cfpsecurite.com
Redirect Base cfpsecurite.com
Domain IPs 46.105.75.14
Redirect IPs 46.105.75.14
Response IP 46.105.75.14
Found Yes
Hash 17da9d5f632e782d9f1d36103545c98debcd23fb3e31c3dffde0bb29075a68d7
SimHash 421559c2c85a

Groups

*

Rule Path
Allow /
Disallow /404/
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /*.json$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /guest-carts/
Disallow /v1/
Disallow /rest/
Disallow /leslomadire/
Disallow /*SID%3D
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /enable-cookies/
Disallow /LICENSE.txt
Disallow /LICENSE.html
Disallow /skin/
Disallow /js/
Disallow /directory/
Disallow /categorytab/

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

fasterfox

Rule Path
Disallow /

boitho.com-dc

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

aranhabot

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

discobot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

kalooga

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

penthesilea

Rule Path
Disallow /

phpdig

Rule Path
Disallow /

searchdaimon.com-dc

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

woozweb-monitoring

Rule Path
Disallow /

woriobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

web-ceo-online-bot

Rule Path
Disallow /

akamai

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

halebot

Rule Path
Disallow /*

pingdom.com_bot

Rule Path
Disallow /*

voilabot

Rule Path
Disallow /*

Other Records

Field Value
sitemap https://www.cfpsecurite.com/sitemap.xml
sitemap https://www.cfpsecurite.it/sitemap_it.xml
sitemap https://www.cfpsecurite.es/sitemap_es.xml
sitemap https://www.cfpsecurite.pt/sitemap_pt.xml
sitemap https://www.cfpsecurite.de/sitemap_de.xml
sitemap https://www.cfpsecurite.nl/sitemap_nl.xml

Comments

  • Google agent
  • Blocage agent