fitnessbit.ru
robots.txt

Robots Exclusion Standard data for fitnessbit.ru

Resource Scan

Scan Details

Site Domain fitnessbit.ru
Base Domain fitnessbit.ru
Scan Status Ok
Last Scan2024-06-10T18:55:22+00:00
Next Scan 2024-06-17T18:55:22+00:00

Last Scan

Scanned2024-06-10T18:55:22+00:00
URL https://fitnessbit.ru/robots.txt
Redirect https://fitnessbit.info/robots.txt
Redirect Domain fitnessbit.info
Redirect Base fitnessbit.info
Domain IPs 87.236.16.206
Redirect IPs 87.236.16.206
Response IP 87.236.16.206
Found Yes
Hash e4ce088ca16a4a8ce67179d0664df3c8f3926e3fed85838f377499b7b2c5097a
SimHash 4b7740779699

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-admin/admin-ajax.php
Disallow /wp-includes
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-comments
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */wp-includes*
Disallow */wp-json/*
Disallow /xmlrpc.php
Disallow /search
Disallow /nadavi-api
Disallow /?*
Disallow /q2hxgsh8virusdie.php
Disallow /template.html
Disallow /?recaptcha-opt-in=true
Disallow */trackback/
Disallow */comments
Disallow */comment
Disallow /?unapproved*
Disallow /?nowprocket*
Disallow /?speake*
Disallow /?tpclid*
Disallow /files/
Disallow /?wp-subscription-manager*
Disallow */comment
Disallow */attachment/*
Disallow */page/*
Disallow /stylesheet
Disallow /pingback
Disallow /%26quot
Disallow /undefined
Disallow /null
Disallow *?*
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-admin/admin-ajax.php
Disallow /wp-includes
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-comments
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */wp-includes*
Disallow */wp-json/*
Disallow /xmlrpc.php
Disallow /search
Disallow /nadavi-api
Disallow /?*
Disallow /q2hxgsh8virusdie.php
Disallow /template.html
Disallow /?recaptcha-opt-in=true
Disallow */trackback/
Disallow */comments
Disallow */comment
Disallow /?unapproved*
Disallow /?nowprocket*
Disallow /?speake*
Disallow /?tpclid*
Disallow /files/
Disallow /?wp-subscription-manager*
Disallow */comment
Disallow */attachment/*
Disallow */page/*
Disallow /stylesheet
Disallow /pingback
Disallow /%26quot
Disallow /undefined
Disallow /null
Disallow *?*
Allow /wp-content/uploads/
Allow /wp-includes/js/
Allow /wp-content/uploads/
Allow /wp-includes/*.css
Allow /wp-includes/*.js
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js

*

Rule Path
Disallow /wp-admin
Disallow /wp-admin/admin-ajax.php
Disallow /wp-includes
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-comments
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */wp-includes*
Disallow */wp-json/*
Disallow /xmlrpc.php
Disallow /search
Disallow /nadavi-api
Disallow /?*
Disallow /q2hxgsh8virusdie.php
Disallow /template.html
Disallow /?recaptcha-opt-in=true
Disallow */trackback/
Disallow */comments
Disallow */comment
Disallow /?unapproved*
Disallow /?nowprocket*
Disallow /?speake*
Disallow /?tpclid*
Disallow /files/
Disallow /?wp-subscription-manager*
Disallow */comment
Disallow */attachment/*
Disallow */page/*
Disallow /stylesheet
Disallow /pingback
Disallow /%26quot
Disallow /undefined
Disallow /null
Disallow *?*
Allow /wp-content/uploads/

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

ia_archiver

Rule Path
Disallow /

bubing

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

begun

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

trident

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 4

trendictionbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

Warnings

  • `clean-param` is not a known field.