askubuntu.ru
robots.txt

Robots Exclusion Standard data for askubuntu.ru

Resource Scan

Scan Details

Site Domain askubuntu.ru
Base Domain askubuntu.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T22:46:37+00:00
Next Scan 2024-11-20T22:46:37+00:00

Last Successful Scan

Scanned2024-07-24T22:43:14+00:00
URL https://askubuntu.ru/robots.txt
Domain IPs 193.42.110.57
Response IP 193.42.110.57
Found Yes
Hash 70994ee7efc7382872b2b5a93e242d44e467ef704f752eec3ead899acecd5ab2
SimHash c19448f2ceb1

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mappy

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

olecrawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

riddler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

teleport

Rule Path
Disallow /

offline

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

larbin

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

moget

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /admin
Disallow /go.php
Disallow /go*

Other Records

Field Value
sitemap https://askubuntu.ru/sitemap.xml

Warnings

  • `host` is not a known field.