speedtest.net.ru
robots.txt

Robots Exclusion Standard data for speedtest.net.ru

Resource Scan

Scan Details

Site Domain speedtest.net.ru
Base Domain speedtest.net.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-25T23:51:11+00:00
Next Scan 2024-08-23T23:51:11+00:00

Last Successful Scan

Scanned2023-01-30T21:06:13+00:00
URL https://speedtest.net.ru/robots.txt
Domain IPs 104.21.64.190, 172.67.187.96, 2606:4700:3031::ac43:bb60, 2606:4700:3035::6815:40be
Response IP 104.21.64.190
Found Yes
Hash ea015683f6f3f7a3353767861480db5f447b8626eb6e742583fa7d61a35f88d6
SimHash 5865c154bc96

Groups

*

Rule Path
Allow *.js
Allow *.css
Allow *.png
Allow *.jpg
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-json/
Disallow /cgi-bin/
Disallow /uncategorized/
Disallow /author/
Disallow */feed/
Disallow */trackback/
Disallow /*?*
Disallow /go/
Disallow /resources.xml
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/

googlebot

Rule Path
Allow *.js
Allow *.css
Allow *.png
Allow *.jpg
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-content/*.png
Allow /wp-content/*.jpg
Allow /wp-content/*.svg
Allow /wp-content/*.apk
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-json/
Disallow /cgi-bin/
Disallow /uncategorized/
Disallow /author/
Disallow */feed/
Disallow */trackback/
Disallow /*?*
Disallow /go/
Disallow /zerkalo/
Disallow /resources.xml
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/

yandex

Rule Path
Allow *.js
Allow *.css
Allow *.png
Allow *.jpg
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-content/*.png
Allow /wp-content/*.jpg
Allow /wp-content/*.svg
Allow /wp-content/*.apk
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-json/
Disallow /cgi-bin/
Disallow /uncategorized/
Disallow /author/
Disallow */feed/
Disallow */trackback/
Disallow /*?*
Disallow /go/
Disallow /zerkalo/
Disallow /amp/
Disallow */amp/*
Disallow /resources.xml
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/

Other Records

Field Value
sitemap https://speedtest.net.ru/sitemap.xml