cinemate.cc
robots.txt

Robots Exclusion Standard data for cinemate.cc

Resource Scan

Scan Details

Site Domain cinemate.cc
Base Domain cinemate.cc
Scan Status Ok
Last Scan2024-05-22T04:03:51+00:00
Next Scan 2024-06-21T04:03:51+00:00

Last Scan

Scanned2024-05-22T04:03:51+00:00
URL https://cinemate.cc/robots.txt
Domain IPs 104.21.18.134, 172.67.181.222, 2606:4700:3032::ac43:b5de, 2606:4700:3033::6815:1286
Response IP 172.67.181.222
Found Yes
Hash ee3819d9521ab3ee7341bc9b13c72b9f655a98eb0c00763da5a5a4a7995c39c2
SimHash 02d25c01e9b9

Groups

mail.ru
yandex

Rule Path
Disallow /community/
Disallow /captcha/
Disallow /profile/
Disallow /registration/
Disallow /login/
Disallow /tos/
Disallow /site/
Disallow /contacts/
Disallow /copyright_holders/
Disallow /api/
Disallow /search/
Disallow /forum/post/
Disallow /go/
Disallow /set/
Disallow /report/
Disallow /movie/filter/
Disallow /*/links/all/$
Disallow /*/links/get/$
Disallow /*/share/livejournal/$
Disallow /*/share/moimir/$
Disallow /*/share/vkontakte/$
Disallow /person/*/actor/
Disallow /person/*/director/
Disallow /person/*/topics/
Disallow /movie/*/comments/
Disallow /movie/*/searchonline/
Disallow /feeds/
Disallow /rating/

google

Rule Path
Disallow /community/
Disallow /captcha/
Disallow /profile/
Disallow /registration/
Disallow /login/
Disallow /tos/
Disallow /site/
Disallow /contacts/
Disallow /copyright_holders/
Disallow /api/
Disallow /search/
Disallow /forum/post/
Disallow /go/
Disallow /set/
Disallow /report/
Disallow /movie/filter/
Disallow /*/links/all/$
Disallow /*/links/get/$
Disallow /*/share/livejournal/$
Disallow /*/share/moimir/$
Disallow /*/share/vkontakte/$
Disallow /person/*/actor/
Disallow /person/*/director/
Disallow /person/*/topics/
Disallow /movie/*/comments/
Disallow /movie/*/searchonline/
Disallow /feeds/
Disallow /rating/

googlebot-image

Rule Path
Disallow /media/images/avatars

*

Rule Path
Disallow /community/
Disallow /captcha/
Disallow /profile/
Disallow /registration/
Disallow /login/
Disallow /tos/
Disallow /site/
Disallow /contacts/
Disallow /copyright_holders/
Disallow /api/
Disallow /search/
Disallow /forum/post/
Disallow /go/
Disallow /set/
Disallow /report/
Disallow /movie/filter/
Disallow /*/links/all/$
Disallow /*/links/get/$
Disallow /*/share/livejournal/$
Disallow /*/share/moimir/$
Disallow /*/share/vkontakte/$
Disallow /person/*/actor/
Disallow /person/*/director/
Disallow /person/*/topics/
Disallow /movie/*/comments/
Disallow /movie/*/searchonline/
Disallow /feeds/
Disallow /rating/

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

openstat.ru/bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cinemate.cc/sitemap.xml

Warnings

  • 1 invalid line.
  • `clean-param` is not a known field.
  • `host` is not a known field.