Log In Sign Up

kitconsult.pro
robots.txt

Robots Exclusion Standard data for kitconsult.pro

Resource Scan

Scan Details

Site Domain kitconsult.pro
Base Domain kitconsult.pro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-10T10:43:26+00:00
Next Scan 2024-10-08T10:43:26+00:00

Last Successful Scan

Scanned2023-08-22T08:40:55+00:00
URL https://kitconsult.pro/robots.txt
Domain IPs 104.21.73.91, 172.67.189.86, 2606:4700:3036::6815:495b, 2606:4700:3036::ac43:bd56
Response IP 172.67.189.86
Found Yes
Hash fa5bc4c2062ea1f55df877fd2676ae3b513b52fd3b99b22055699ec17624b84f
SimHash 0d1159a4f090

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

slurp

Rule Path
Allow /

apis-google

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google-mobile-apps

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

duplexweb-google

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

yandexadnet

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexfordomain

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexontodbapi

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

yandexsitelinks

Rule Path
Disallow /

yandexspravbot

Rule Path
Disallow /

yandexturbo

Rule Path
Disallow /

yandexvertis

Rule Path
Disallow /

yandexverticals

Rule Path
Disallow /

yandexvideo

Rule Path
Disallow /

yandexwebmaster

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

scrapebox

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top