academia.fzrw.info
robots.txt

Robots Exclusion Standard data for academia.fzrw.info

Resource Scan

Scan Details

Site Domain academia.fzrw.info
Base Domain fzrw.info
Scan Status Ok
Last Scan2024-09-14T22:07:40+00:00
Next Scan 2024-10-14T22:07:40+00:00

Last Scan

Scanned2024-09-14T22:07:40+00:00
URL https://academia.fzrw.info/robots.txt
Domain IPs 159.100.243.133, 2a04:c43:e00:6d3e:4e2:c6ff:fe00:72a
Response IP 159.100.243.133
Found Yes
Hash fdcc454d5ea97693430f653044e0b5ae09b8a70a1ac4b37c40ff730fddc55c8b
SimHash 2af6d9434090

Groups

applebot-extended

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google-mobile-apps

Rule Path
Disallow /

yandexadnet

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandexdirectdyn

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

*

Rule Path
Disallow /files/

*

Rule Path
Disallow /ru/privacy

*

Rule Path
Disallow /en/privacy

*

Rule Path
Disallow /ru/rss

*

Rule Path
Disallow /en/rss

*

Rule Path
Disallow /ru/feed

*

Rule Path
Disallow /en/feed