speedtest.net.ru
robots.txt
Robots Exclusion Standard data for speedtest.net.ru
Resource Scan
Scan Details
Site Domain | speedtest.net.ru |
Base Domain | speedtest.net.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-25T23:51:11+00:00 |
Next Scan | 2024-08-23T23:51:11+00:00 |
Last Successful Scan
Scanned | 2023-01-30T21:06:13+00:00 |
URL | https://speedtest.net.ru/robots.txt |
Domain IPs | 104.21.64.190, 172.67.187.96, 2606:4700:3031::ac43:bb60, 2606:4700:3035::6815:40be |
Response IP | 104.21.64.190 |
Found | Yes |
Hash | ea015683f6f3f7a3353767861480db5f447b8626eb6e742583fa7d61a35f88d6 |
SimHash | 5865c154bc96 |
Groups
*
Rule | Path |
---|---|
Allow | *.js |
Allow | *.css |
Allow | *.png |
Allow | *.jpg |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /wp-json/ |
Disallow | /cgi-bin/ |
Disallow | /uncategorized/ |
Disallow | /author/ |
Disallow | */feed/ |
Disallow | */trackback/ |
Disallow | /*?* |
Disallow | /go/ |
Disallow | /resources.xml |
Disallow | /wp-admin/ |
Disallow | /wp-content/ |
Disallow | /wp-includes/ |
googlebot
Rule | Path |
---|---|
Allow | *.js |
Allow | *.css |
Allow | *.png |
Allow | *.jpg |
Allow | /wp-content/*.js |
Allow | /wp-content/*.css |
Allow | /wp-content/*.png |
Allow | /wp-content/*.jpg |
Allow | /wp-content/*.svg |
Allow | /wp-content/*.apk |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /wp-json/ |
Disallow | /cgi-bin/ |
Disallow | /uncategorized/ |
Disallow | /author/ |
Disallow | */feed/ |
Disallow | */trackback/ |
Disallow | /*?* |
Disallow | /go/ |
Disallow | /zerkalo/ |
Disallow | /resources.xml |
Disallow | /wp-admin/ |
Disallow | /wp-content/ |
Disallow | /wp-includes/ |
yandex
Rule | Path |
---|---|
Allow | *.js |
Allow | *.css |
Allow | *.png |
Allow | *.jpg |
Allow | /wp-content/*.js |
Allow | /wp-content/*.css |
Allow | /wp-content/*.png |
Allow | /wp-content/*.jpg |
Allow | /wp-content/*.svg |
Allow | /wp-content/*.apk |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /wp-json/ |
Disallow | /cgi-bin/ |
Disallow | /uncategorized/ |
Disallow | /author/ |
Disallow | */feed/ |
Disallow | */trackback/ |
Disallow | /*?* |
Disallow | /go/ |
Disallow | /zerkalo/ |
Disallow | /amp/ |
Disallow | */amp/* |
Disallow | /resources.xml |
Disallow | /wp-admin/ |
Disallow | /wp-content/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
sitemap | https://speedtest.net.ru/sitemap.xml |