omb.report
robots.txt

Robots Exclusion Standard data for omb.report

Resource Scan

Scan Details

Site Domain omb.report
Base Domain omb.report
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-28T14:05:49+00:00
Next Scan 2026-03-28T14:05:49+00:00

Last Successful Scan

Scanned2024-09-03T08:30:01+00:00
URL https://omb.report/robots.txt
Domain IPs 172.66.40.89, 172.66.43.167, 2606:4700:3108::ac42:2859, 2606:4700:3108::ac42:2ba7
Response IP 172.66.40.89
Found Yes
Hash f729874901110e057e55b7282028144c1a8e3926e6a123dae4ba4e30f3a22ac2
SimHash d91dcc62e631

Groups

*

Rule Path
Disallow

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

spbot

Rule Path
Disallow /

linguee

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Warnings

  • `host` is not a known field.