internet-technologies.ru
robots.txt

Robots Exclusion Standard data for internet-technologies.ru

Resource Scan

Scan Details

Site Domain internet-technologies.ru
Base Domain internet-technologies.ru
Scan Status Ok
Last Scan2024-09-19T00:27:16+00:00
Next Scan 2024-09-26T00:27:16+00:00

Last Scan

Scanned2024-09-19T00:27:16+00:00
URL https://internet-technologies.ru/robots.txt
Redirect https://www.internet-technologies.ru/robots.txt
Redirect Domain www.internet-technologies.ru
Redirect Base internet-technologies.ru
Domain IPs 82.146.51.28
Redirect IPs 82.146.51.28
Response IP 82.146.51.28
Found Yes
Hash 78c647151afb74cd7c003de9529f89e06385fe529a675160ff745624f84fb4fc
SimHash 0f3ecb413632

Groups

yandex

Rule Path
Disallow /assets
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Allow /wp-content/assets
Allow /wp-content/themes
Allow /wp-content/plugins
Allow /wp-content/uploads
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow */assets/fonts/*
Allow /feed/turbo*
Allow /feed/zen*
Disallow /wp-content/assets/images/
Disallow /wp-content/plugins/wpdiscuz/
Disallow */author/*
Disallow /201*/
Disallow /202*/
Disallow /go/*
Disallow *page%3D*
Disallow */trackback/
Disallow /search
Disallow */comments/
Disallow */comment
Disallow */tag/*
Disallow */attachment/*
Disallow */ajax-header.php
Disallow /ajax.php
Disallow /?*
Disallow *PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv

googlebot

Rule Path
Disallow /assets
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Allow /wp-content/assets
Allow /wp-content/themes
Allow /wp-content/plugins
Allow /wp-content/uploads
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow */assets/fonts/*
Allow /feed/turbo*
Allow /feed/zen*
Disallow /wp-content/assets/images/
Disallow /wp-content/plugins/wpdiscuz/
Disallow */author/*
Disallow /201*/
Disallow /202*/
Disallow /go/*
Disallow *page%3D*
Disallow */trackback/
Disallow /search
Disallow */comments/
Disallow */comment
Disallow */tag/*
Disallow */attachment/*
Disallow */ajax-header.php
Disallow /ajax.php
Disallow /?*
Allow /assets/?f=
Disallow *PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv

mail.ru

Rule Path
Disallow /assets
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Allow /wp-content/assets
Allow /wp-content/themes
Allow /wp-content/plugins
Allow /wp-content/uploads
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow */assets/fonts/*
Allow /feed/turbo*
Allow /feed/zen*
Disallow /wp-content/assets/images/
Disallow /wp-content/plugins/wpdiscuz/
Disallow */author/*
Disallow /201*/
Disallow /202*/
Disallow /go/*
Disallow *page%3D*
Disallow */trackback/
Disallow /search
Disallow */comments/
Disallow */comment
Disallow */tag/*
Disallow */attachment/*
Disallow */ajax-header.php
Disallow /ajax.php
Disallow /?*
Disallow *PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv

*

Rule Path
Disallow /assets
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Allow /wp-content/assets
Allow /wp-content/themes
Allow /wp-content/plugins
Allow /wp-content/uploads
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow */assets/fonts/*
Allow /feed/turbo*
Allow /feed/zen*
Disallow /wp-content/assets/images/
Disallow /wp-content/plugins/wpdiscuz/
Disallow */author/*
Disallow /201*/
Disallow /202*/
Disallow /go/*
Disallow *page%3D*
Disallow */trackback/
Disallow /search
Disallow */comments/
Disallow */comment
Disallow */tag/*
Disallow */attachment/*
Disallow */ajax-header.php
Disallow /ajax.php
Disallow /?*
Disallow *PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv

googlebot-image

Rule Path
Disallow
Disallow *PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv

yandeximages

Rule Path
Disallow
Disallow *PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv

yadirectbot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.