Log In Sign Up

bibliouao.ru
robots.txt

Robots Exclusion Standard data for bibliouao.ru

Resource Scan

Scan Details

Site Domain bibliouao.ru
Base Domain bibliouao.ru
Scan Status Ok
Last Scan2024-05-31T11:16:40+00:00
Next Scan 2024-06-30T11:16:40+00:00

Last Scan

Scanned2024-05-31T11:16:40+00:00
URL https://bibliouao.ru/robots.txt
Domain IPs 87.236.16.32
Response IP 87.236.16.32
Found Yes
Hash de469a2b9e8d54631bb36114d6fcbda70308bd97d09f6a281841d53aa9db2cd9
SimHash 3a5dde637e8a

Groups

*
googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

begun

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /
Back to top