Log In Sign Up

cfdsea.com
robots.txt

Robots Exclusion Standard data for cfdsea.com

Resource Scan

Scan Details

Site Domain cfdsea.com
Base Domain cfdsea.com
Scan Status Ok
Last Scan2024-11-14T23:35:12+00:00
Next Scan 2024-12-14T23:35:12+00:00

Last Scan

Scanned2024-11-14T23:35:12+00:00
URL https://cfdsea.com/robots.txt
Domain IPs 104.21.83.183, 172.67.180.127, 2606:4700:3031::ac43:b47f, 2606:4700:3037::6815:53b7
Response IP 172.67.180.127
Found Yes
Hash fa5bc4c2062ea1f55df877fd2676ae3b513b52fd3b99b22055699ec17624b84f
SimHash 0d1159a4f090

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

slurp

Rule Path
Allow /

apis-google

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google-mobile-apps

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

duplexweb-google

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

yandexadnet

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexfordomain

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexontodbapi

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

yandexsitelinks

Rule Path
Disallow /

yandexspravbot

Rule Path
Disallow /

yandexturbo

Rule Path
Disallow /

yandexvertis

Rule Path
Disallow /

yandexverticals

Rule Path
Disallow /

yandexvideo

Rule Path
Disallow /

yandexwebmaster

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

scrapebox

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top