opendi.run
robots.txt

Robots Exclusion Standard data for opendi.run

Resource Scan

Scan Details

Site Domain opendi.run
Base Domain opendi.run
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-09T02:05:24+00:00
Next Scan 2024-11-07T02:05:24+00:00

Last Successful Scan

Scanned2024-01-12T22:54:49+00:00
URL https://opendi.run/robots.txt
Domain IPs 2a05:d018:11d9:d500:20cf:46e:281b:bd81, 2a05:d018:11d9:d501:ab02:9002:9f00:8731, 2a05:d018:11d9:d502:a5d4:ccea:95c6:494f, 52.208.156.229, 52.211.28.228, 52.214.138.37
Response IP 52.214.138.37
Found Yes
Hash a71ce9f1d3a4df7e6729048f9845411e7dd0e56fa50cd8f50a8e9edd4f818cf7
SimHash 13554fd47ed3

Groups

*

Rule Path
Disallow /ajax/
Disallow /*jqLite
Disallow /*lib/util
Disallow /search
Disallow /wp-admin

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

orangebot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

binlar

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

domainappender

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

hypercrawl

Rule Path
Disallow /

exabot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Comments

  • robots.txt for opendi || AS 2015.07.26