eurobeton.ru
robots.txt

Robots Exclusion Standard data for eurobeton.ru

Resource Scan

Scan Details

Site Domain eurobeton.ru
Base Domain eurobeton.ru
Scan Status Ok
Last Scan2024-10-01T17:51:46+00:00
Next Scan 2024-10-31T17:51:46+00:00

Last Scan

Scanned2024-10-01T17:51:46+00:00
URL https://eurobeton.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:3:0:169, 31.31.198.223
Response IP 31.31.198.223
Found Yes
Hash d8e9f6ee9644031576361dfe3130c1fe85fcfeed49574617fe0b15c1b9c01dd7
SimHash 56969c71df0d

Groups

*

Rule Path
Disallow /auth/
Disallow /personal/
Disallow /upload/
Disallow /search/
Disallow /*/search/
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*%26print%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*action%3D*
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*print_course%3DY
Disallow /*COURSE_ID%3D
Disallow /*PAGE_*
Disallow /*SHOWALL
Disallow /*show_all%3D
Disallow /*?oid=
Disallow *?
Disallow *get-next*
Disallow */utils/*
Disallow /proizvodstvo/$
Allow /upload/*.css
Allow /upload/*.js
Allow /upload/*.jpg
Allow /upload/*.png
Allow /upload/*.gif
Allow /upload/*.webp
Allow /bitrix/js/*
Allow *.css
Allow *.webp
Allow *.js
Allow *.jpg
Allow *.gif
Allow *.png
Allow *PAGEN_1%3D*
Disallow */filter/*-is-*/*
Disallow */filter/clear/apply/*
Disallow /?bxajaxid=

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

moz

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serendeputy

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

seopultcontentanalyzer

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

weborama

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

riddler

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

pr-cy.ru

Rule Path
Disallow /

paloaltonetworks

Rule Path
Disallow /

backupland

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

hello, world

Rule Path
Disallow /

nuclei

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

academicbotrtu

Rule Path
Disallow /

statdom

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://eurobeton.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.