shrek-mult.ru
robots.txt

Robots Exclusion Standard data for shrek-mult.ru

Resource Scan

Scan Details

Site Domain shrek-mult.ru
Base Domain shrek-mult.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-18T15:43:19+00:00
Next Scan 2024-08-16T15:43:19+00:00

Last Successful Scan

Scanned2023-10-22T14:53:09+00:00
URL https://shrek-mult.ru/robots.txt
Domain IPs 104.21.24.23, 172.67.216.121, 2606:4700:3035::ac43:d879, 2606:4700:3037::6815:1817
Response IP 104.21.24.23
Found Yes
Hash 48a74969a1ebd2512f5e6c3d2652030691b1abd4c1f0c47d6b34d1af35f766ed
SimHash 6f31d766025c

Groups

yandex

Rule Path
Disallow /player
Disallow /film
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /search*
Disallow /search
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */trackback/
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow */embed*
Disallow /cgi-bin
Disallow */feed/
Disallow /feed/
Disallow /?feed=
Disallow /goto/
Disallow /go?
Disallow /tmp/
Disallow *?s*
Disallow *?s=
Disallow /*?
Disallow /?s=
Disallow /?s=*
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /player
Disallow /film
Disallow /wp-admin
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /wp-json/
Disallow /cgi-bin
Disallow */feed/
Disallow /feed/
Disallow /?feed=
Disallow /goto/
Disallow /go?
Disallow /tmp/
Disallow /tmp/
Disallow /goto/
Disallow *?s*
Disallow *?s=
Disallow /*?
Disallow /?s=
Disallow /?s=*
Disallow /search
Disallow /search*
Disallow */trackback/
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow */embed*
Allow /wp-content/uploads/

mail.ru

Rule Path
Disallow /player
Disallow /film
Disallow /wp-admin
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /wp-json/
Disallow /cgi-bin
Disallow */feed/
Disallow /feed/
Disallow /?feed=
Disallow /goto/
Disallow /go?
Disallow /tmp/
Disallow /tmp/
Disallow /goto/
Disallow *?s*
Disallow *?s=
Disallow /*?
Disallow /?s=
Disallow /?s=*
Disallow /search
Disallow /search*
Disallow */trackback/
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow */embed*
Allow /wp-content/uploads/

*

Rule Path
Disallow /player
Disallow /film
Disallow /wp-admin
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /wp-json/
Disallow /cgi-bin
Disallow */feed/
Disallow /feed/
Disallow /?feed=
Disallow /goto/
Disallow /go?
Disallow /tmp/
Disallow /tmp/
Disallow /goto/
Disallow *?s*
Disallow *?s=
Disallow /*?
Disallow /?s=
Disallow /?s=*
Disallow /search
Disallow /search*
Disallow */trackback/
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow */embed*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://shrek-mult.ru/sitemap_index.xml