creditvsbervbanke.ru
robots.txt

Robots Exclusion Standard data for creditvsbervbanke.ru

Resource Scan

Scan Details

Site Domain creditvsbervbanke.ru
Base Domain creditvsbervbanke.ru
Scan Status Ok
Last Scan2024-10-11T10:18:14+00:00
Next Scan 2024-10-18T10:18:14+00:00

Last Scan

Scanned2024-10-11T10:18:14+00:00
URL https://creditvsbervbanke.ru/robots.txt
Domain IPs 87.236.16.6
Response IP 87.236.16.6
Found Yes
Hash 78c1d9c03c31c8c0062d8fffba9b7310f7597f83faba000dcfc558493db6c53d
SimHash 8f119ef783bc

Groups

*

Rule Path
Allow /wp-content/uploads/*.png$
Allow /wp-content/uploads/*.jpg$
Allow /wp-content/uploads/*.jpeg$
Allow /wp-content/uploads/*.gif$
Disallow /*p%3D*
Disallow /page/1$
Disallow /cgi-bin
Disallow /wp-admin
Disallow */feed
Disallow /tag/*
Disallow /tag$
Disallow /xmlrpc.php
Disallow /wp-json
Disallow /?s=
Disallow /cgi-sys
Disallow /*.html
Disallow /*?
Disallow /single

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://creditvsbervbanke.ru/sitemap.xml

Warnings

  • `host` is not a known field.