Log In Sign Up

cross.expert
robots.txt

Robots Exclusion Standard data for cross.expert

Resource Scan

Scan Details

Site Domain cross.expert
Base Domain cross.expert
Scan Status Ok
Last Scan2024-10-31T11:14:07+00:00
Next Scan 2024-11-07T11:14:07+00:00

Last Scan

Scanned2024-10-31T11:14:07+00:00
URL https://cross.expert/robots.txt
Domain IPs 104.21.47.38, 172.67.170.92, 2606:4700:3034::6815:2f26, 2606:4700:3036::ac43:aa5c
Response IP 104.21.47.38
Found Yes
Hash 34a86a481a7b96065edbe2865fba1411739546ce40d3bef216f48693cecd1e24
SimHash 2d6f404f02f1

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow */feed
Disallow /?s=*
Disallow *%26*
Disallow /search*
Disallow */trackback/
Disallow */comments/
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */page/*
Disallow /partners/*
Disallow */tag/*
Disallow *userauth%3D*
Disallow */wall/*
Disallow /dobavit-zal
Disallow */profile/*
Disallow /category/uprazhneniya?*
Disallow /category/zdorovoe-pitanie/recipes?*
Disallow /category/sportivnoe-pitanie?*
Disallow /wod?*
Disallow /event?*
Disallow *?*ftime=*
Disallow *?*ctime=*
Disallow *?*fsort=*
Disallow *?*fprice=*
Disallow /profil
Disallow */wod_tag/*
Disallow */news/2017*
Disallow */news/2018*
Disallow */en/*
Disallow /showthread.php
Disallow /forumdisplay.php
Disallow /profile/*?tab=*
Allow /wp-content/uploads/
Allow /wp-content/cache_img/
Allow /wp-content/cache/
Allow /wp-content/themes/*.css
Allow /wp-content/plugins/*.css
Allow /wp-content/themes/*.js
Allow /wp-content/plugins/*.js
Allow /wp-includes/css/
Allow /wp-includes/js/
Allow /wp-includes/images/
Allow /wp-content/themes/crossfit/dist/fonts/
Allow /profile/ivan-tungusov
Allow /profile/evgeniya-snopko
Allow /profile/lyudmila-javoronkova
Allow /profile/yakhvatov
Allow /profile/mariya-ladygina
Allow /profile/mariya-ladygina?tab=posts
Allow /profile/ivan-tungusov?tab=posts
Allow /profile/evgeniya-snopko?tab=posts
Allow /profile/lyudmila-javoronkova?tab=posts
Allow /profile/yakhvatov?tab=posts
Disallow /profile/*/page/*
Disallow /profile/ivan-tungusov/page/*
Disallow /profile/evgeniya-snopko/page/*
Disallow /profile/lyudmila-javoronkova/page/*
Disallow /profile/yakhvatov/page/*
Disallow /profile/mariya-ladygina/page/*

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */page/*
Disallow /partners/*
Disallow */tag/*
Disallow *userauth%3D*
Disallow *%26*
Disallow */wall/*
Disallow /dobavit-zal
Disallow */profile/*
Disallow /category/uprazhneniya?*
Disallow /category/zdorovoe-pitanie/recipes?*
Disallow /category/sportivnoe-pitanie?*
Disallow /wod?*
Disallow /event?*
Disallow *?*ftime=*
Disallow *?*ctime=*
Disallow *?*fsort=*
Disallow *?*fprice=*
Disallow /profil
Disallow */wod_tag/*
Disallow */news/2017*
Disallow */news/2018*
Disallow */en/*
Disallow /showthread.php
Disallow /forumdisplay.php
Disallow /profile/*?tab=*
Allow /wp-content/uploads/
Allow /wp-content/cache_img/
Allow /wp-content/cache/
Allow /wp-content/themes/*.css
Allow /wp-content/plugins/*.css
Allow /wp-content/themes/*.js
Allow /wp-content/plugins/*.js
Allow /wp-includes/css/
Allow /wp-includes/js/
Allow /wp-includes/images/
Allow /wp-content/themes/crossfit/dist/fonts/
Allow /profile/ivan-tungusov
Allow /profile/evgeniya-snopko
Allow /profile/lyudmila-javoronkova
Allow /profile/yakhvatov
Allow /profile/mariya-ladygina
Allow /profile/mariya-ladygina?tab=posts
Allow /profile/ivan-tungusov?tab=posts
Allow /profile/evgeniya-snopko?tab=posts
Allow /profile/lyudmila-javoronkova?tab=posts
Allow /profile/yakhvatov?tab=posts
Disallow /profile/*/page/*
Disallow /profile/ivan-tungusov/page/*
Disallow /profile/evgeniya-snopko/page/*
Disallow /profile/lyudmila-javoronkova/page/*
Disallow /profile/yakhvatov/page/*
Disallow /profile/mariya-ladygina/page/*

mail.ru

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */page/*
Disallow /partners/*
Disallow */tag/*
Disallow *userauth%3D*
Disallow *%26*
Disallow */wall/*
Disallow /dobavit-zal
Disallow */profile/*
Disallow /category/uprazhneniya?*
Disallow /category/zdorovoe-pitanie/recipes?*
Disallow /category/sportivnoe-pitanie?*
Disallow /wod?*
Disallow /event?*
Disallow *?*ftime=*
Disallow *?*ctime=*
Disallow *?*fsort=*
Disallow *?*fprice=*
Disallow /profil
Disallow */wod_tag/*
Disallow */news/2017*
Disallow */news/2018*
Disallow */en/*
Disallow /showthread.php
Disallow /forumdisplay.php
Disallow /profile/*?tab=*
Allow /wp-content/uploads/
Allow /wp-content/cache_img/
Allow /wp-content/cache/
Allow /wp-content/themes/*.css
Allow /wp-content/plugins/*.css
Allow /wp-content/themes/*.js
Allow /wp-content/plugins/*.js
Allow /wp-includes/css/
Allow /wp-includes/js/
Allow /wp-includes/images/
Allow /wp-content/themes/crossfit/dist/fonts/
Allow /profile/ivan-tungusov
Allow /profile/evgeniya-snopko
Allow /profile/lyudmila-javoronkova
Allow /profile/yakhvatov
Allow /profile/mariya-ladygina
Allow /profile/mariya-ladygina?tab=posts
Allow /profile/ivan-tungusov?tab=posts
Allow /profile/evgeniya-snopko?tab=posts
Allow /profile/lyudmila-javoronkova?tab=posts
Allow /profile/yakhvatov?tab=posts
Disallow /profile/*/page/*
Disallow /profile/ivan-tungusov/page/*
Disallow /profile/evgeniya-snopko/page/*
Disallow /profile/lyudmila-javoronkova/page/*
Disallow /profile/yakhvatov/page/*
Disallow /profile/mariya-ladygina/page/*

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */comments/
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */page/*
Disallow *%26*
Disallow /partners/*
Disallow */tag/*
Disallow *userauth%3D*
Disallow */wall/*
Disallow /dobavit-zal
Disallow */profile/*
Disallow /category/uprazhneniya?*
Disallow /category/zdorovoe-pitanie/recipes?*
Disallow /category/sportivnoe-pitanie?*
Disallow /wod?*
Disallow /event?*
Disallow *?*ftime=*
Disallow *?*ctime=*
Disallow *?*fsort=*
Disallow *?*fprice=*
Disallow /profil
Disallow */wod_tag/*
Disallow */news/2017*
Disallow */news/2018*
Disallow */en/*
Disallow /showthread.php
Disallow /forumdisplay.php
Disallow /profile/*?tab=*
Allow /wp-content/uploads/
Allow /wp-content/cache_img/
Allow /wp-content/cache/
Allow /wp-content/themes/*.css
Allow /wp-content/plugins/*.css
Allow /wp-content/themes/*.js
Allow /wp-content/plugins/*.js
Allow /wp-includes/css/
Allow /wp-includes/js/
Allow /wp-includes/images/
Allow /wp-content/themes/crossfit/dist/fonts/
Allow /profile/ivan-tungusov
Allow /profile/evgeniya-snopko
Allow /profile/lyudmila-javoronkova
Allow /profile/yakhvatov
Allow /profile/mariya-ladygina
Allow /profile/mariya-ladygina?tab=posts
Allow /profile/ivan-tungusov?tab=posts
Allow /profile/evgeniya-snopko?tab=posts
Allow /profile/lyudmila-javoronkova?tab=posts
Allow /profile/yakhvatov?tab=posts
Disallow /profile/*/page/*
Disallow /profile/ivan-tungusov/page/*
Disallow /profile/evgeniya-snopko/page/*
Disallow /profile/lyudmila-javoronkova/page/*
Disallow /profile/yakhvatov/page/*
Disallow /profile/mariya-ladygina/page/*

googlebot-image

Rule Path
Allow /wp-content/uploads/
Allow /wp-content/cache_img/
Allow /wp-content/cache/

yandeximages

Rule Path
Allow /wp-content/uploads/
Allow /wp-content/cache_img/
Allow /wp-content/cache/

yandex

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://cross.expert/sitemap_index.xml
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top